Sep 11 17:45:05.501478 ip-10-0-140-211 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 17:45:05.858195 ip-10-0-140-211 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 17:45:05.858762 ip-10-0-140-211 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 17:45:05.858762 ip-10-0-140-211 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 17:45:05.858762 ip-10-0-140-211 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 17:45:05.858762 ip-10-0-140-211 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 17:45:05.859297 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.859209    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 17:45:05.864012 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.863996    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 17:45:05.864012 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864011    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 17:45:05.864075 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864015    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 17:45:05.864075 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864019    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 17:45:05.864075 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864022    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 17:45:05.864075 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864025    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 17:45:05.864075 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864028    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 17:45:05.864075 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864030    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 17:45:05.864075 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864034    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 17:45:05.864075 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864036    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 17:45:05.864075 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864040    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 17:45:05.864075 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864043    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 17:45:05.864075 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864048    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 17:45:05.864075 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864052    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 17:45:05.864075 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864055    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 17:45:05.864075 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864057    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 17:45:05.864075 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864060    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 17:45:05.864075 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864063    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 17:45:05.864075 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864066    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 17:45:05.864075 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864068    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 17:45:05.864075 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864071    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 17:45:05.864075 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864074    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 17:45:05.864578 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864077    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 17:45:05.864578 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864079    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 17:45:05.864578 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864082    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 17:45:05.864578 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864085    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 17:45:05.864578 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864088    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 17:45:05.864578 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864091    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 17:45:05.864578 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864094    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 17:45:05.864578 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864096    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 17:45:05.864578 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864099    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 17:45:05.864578 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864101    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 17:45:05.864578 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864104    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 17:45:05.864578 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864106    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 17:45:05.864578 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864109    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 17:45:05.864578 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864112    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 17:45:05.864578 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864114    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 17:45:05.864578 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864117    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 17:45:05.864578 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864119    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 17:45:05.864578 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864122    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 17:45:05.864578 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864124    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 17:45:05.865070 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864126    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 17:45:05.865070 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864130    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 17:45:05.865070 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864133    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 17:45:05.865070 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864136    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 17:45:05.865070 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864140    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 17:45:05.865070 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864143    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 17:45:05.865070 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864146    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 17:45:05.865070 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864149    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 17:45:05.865070 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864151    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 17:45:05.865070 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864154    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 17:45:05.865070 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864156    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 17:45:05.865070 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864159    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 17:45:05.865070 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864162    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 17:45:05.865070 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864165    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 17:45:05.865070 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864168    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 17:45:05.865070 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864170    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 17:45:05.865070 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864173    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 17:45:05.865070 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864176    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 17:45:05.865070 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864178    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 17:45:05.865554 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864180    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 17:45:05.865554 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864194    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 17:45:05.865554 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864197    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 17:45:05.865554 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864199    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 17:45:05.865554 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864202    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 17:45:05.865554 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864205    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 17:45:05.865554 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864208    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 17:45:05.865554 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864210    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 17:45:05.865554 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864213    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 17:45:05.865554 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864216    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 17:45:05.865554 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864218    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 17:45:05.865554 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864221    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 17:45:05.865554 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864223    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 17:45:05.865554 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864228    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 17:45:05.865554 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864232    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 17:45:05.865554 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864235    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 17:45:05.865554 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864238    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 17:45:05.865554 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864241    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 17:45:05.865554 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864244    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 17:45:05.866021 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864246    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 17:45:05.866021 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864249    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 17:45:05.866021 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864251    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 17:45:05.866021 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864254    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 17:45:05.866021 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864257    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 17:45:05.866021 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864259    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 17:45:05.866021 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864263    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 17:45:05.866021 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864266    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 17:45:05.866021 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864269    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 17:45:05.866021 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864271    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 17:45:05.866021 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864274    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 17:45:05.866021 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864277    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 17:45:05.866021 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864279    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 17:45:05.866021 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864282    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 17:45:05.866021 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864284    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 17:45:05.866021 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864288    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 17:45:05.866021 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864291    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 17:45:05.866021 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864294    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 17:45:05.866021 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864296    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 17:45:05.866021 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.864299    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 17:45:05.866811 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866798    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 17:45:05.866811 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866810    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 17:45:05.866867 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866813    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 17:45:05.866867 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866816    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 17:45:05.866867 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866819    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 17:45:05.866867 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866822    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 17:45:05.866867 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866825    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 17:45:05.866867 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866828    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 17:45:05.866867 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866831    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 17:45:05.866867 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866833    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 17:45:05.866867 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866837    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 17:45:05.866867 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866839    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 17:45:05.866867 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866842    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 17:45:05.866867 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866845    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 17:45:05.866867 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866847    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 17:45:05.866867 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866850    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 17:45:05.866867 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866853    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 17:45:05.866867 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866856    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 17:45:05.866867 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866858    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 17:45:05.866867 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866861    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 17:45:05.866867 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866864    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 17:45:05.866867 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866866    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 17:45:05.867378 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866869    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 17:45:05.867378 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866872    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 17:45:05.867378 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866875    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 17:45:05.867378 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866877    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 17:45:05.867378 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866880    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 17:45:05.867378 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866883    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 17:45:05.867378 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866886    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 17:45:05.867378 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866888    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 17:45:05.867378 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866891    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 17:45:05.867378 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866893    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 17:45:05.867378 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866896    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 17:45:05.867378 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866898    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 17:45:05.867378 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866901    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 17:45:05.867378 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866904    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 17:45:05.867378 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866906    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 17:45:05.867378 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866909    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 17:45:05.867378 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866912    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 17:45:05.867378 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866916    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 17:45:05.867378 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866920    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 17:45:05.867888 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866922    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 17:45:05.867888 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866926    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 17:45:05.867888 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866929    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 17:45:05.867888 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866932    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 17:45:05.867888 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866934    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 17:45:05.867888 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866939    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 17:45:05.867888 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866942    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 17:45:05.867888 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866945    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 17:45:05.867888 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866947    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 17:45:05.867888 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866950    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 17:45:05.867888 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866953    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 17:45:05.867888 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866956    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 17:45:05.867888 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866958    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 17:45:05.867888 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866961    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 17:45:05.867888 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866964    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 17:45:05.867888 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866967    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 17:45:05.867888 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866970    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 17:45:05.867888 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866972    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 17:45:05.867888 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866975    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 17:45:05.867888 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866978    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 17:45:05.868482 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866980    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 17:45:05.868482 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866983    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 17:45:05.868482 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866986    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 17:45:05.868482 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866988    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 17:45:05.868482 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866991    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 17:45:05.868482 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866994    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 17:45:05.868482 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866996    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 17:45:05.868482 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.866999    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 17:45:05.868482 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867001    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 17:45:05.868482 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867004    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 17:45:05.868482 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867006    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 17:45:05.868482 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867010    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 17:45:05.868482 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867013    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 17:45:05.868482 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867016    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 17:45:05.868482 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867020    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 17:45:05.868482 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867023    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 17:45:05.868482 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867026    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 17:45:05.868482 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867028    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 17:45:05.868482 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867031    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 17:45:05.868482 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867033    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 17:45:05.869274 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867037    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 17:45:05.869274 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867041    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 17:45:05.869274 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867045    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 17:45:05.869274 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867048    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 17:45:05.869274 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867051    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 17:45:05.869274 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867054    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 17:45:05.869274 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867057    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 17:45:05.869274 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867060    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 17:45:05.869274 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867062    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 17:45:05.869274 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867065    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 17:45:05.869274 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867068    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 17:45:05.869274 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867070    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 17:45:05.869274 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867073    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 17:45:05.869274 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867076    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 17:45:05.869274 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867078    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 17:45:05.869274 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867081    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 17:45:05.869274 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867084    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 17:45:05.869274 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867086    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 17:45:05.869274 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867476    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 17:45:05.869927 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867481    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 17:45:05.869927 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867483    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 17:45:05.869927 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867486    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 17:45:05.869927 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867491    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 17:45:05.869927 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867496    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 17:45:05.869927 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867499    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 17:45:05.869927 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867503    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 17:45:05.869927 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867507    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 17:45:05.869927 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867511    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 17:45:05.869927 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867514    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 17:45:05.869927 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867517    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 17:45:05.869927 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867520    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 17:45:05.869927 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867522    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 17:45:05.869927 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867525    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 17:45:05.869927 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867528    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 17:45:05.869927 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867531    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 17:45:05.869927 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867534    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 17:45:05.869927 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867537    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 17:45:05.869927 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867539    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 17:45:05.870585 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867542    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 17:45:05.870585 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867545    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 17:45:05.870585 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867547    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 17:45:05.870585 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867550    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 17:45:05.870585 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867552    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 17:45:05.870585 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867555    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 17:45:05.870585 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867558    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 17:45:05.870585 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867560    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 17:45:05.870585 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867563    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 17:45:05.870585 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867565    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 17:45:05.870585 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867568    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 17:45:05.870585 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867571    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 17:45:05.870585 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867573    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 17:45:05.870585 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867576    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 17:45:05.870585 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867578    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 17:45:05.870585 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867581    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 17:45:05.870585 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867583    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 17:45:05.870585 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867586    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 17:45:05.870585 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867589    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 17:45:05.870585 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867591    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 17:45:05.871078 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867594    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 17:45:05.871078 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867597    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 17:45:05.871078 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867600    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 17:45:05.871078 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867603    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 17:45:05.871078 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867606    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 17:45:05.871078 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867609    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 17:45:05.871078 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867611    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 17:45:05.871078 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867614    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 17:45:05.871078 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867616    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 17:45:05.871078 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867619    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 17:45:05.871078 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867622    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 17:45:05.871078 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867625    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 17:45:05.871078 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867627    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 17:45:05.871078 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867630    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 17:45:05.871078 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867632    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 17:45:05.871078 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867635    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 17:45:05.871078 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867637    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 17:45:05.871078 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867640    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 17:45:05.871078 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867642    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 17:45:05.871078 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867645    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 17:45:05.871672 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867647    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 17:45:05.871672 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867650    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 17:45:05.871672 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867652    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 17:45:05.871672 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867654    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 17:45:05.871672 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867657    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 17:45:05.871672 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867659    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 17:45:05.871672 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867662    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 17:45:05.871672 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867664    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 17:45:05.871672 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867667    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 17:45:05.871672 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867669    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 17:45:05.871672 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867672    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 17:45:05.871672 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867675    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 17:45:05.871672 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867677    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 17:45:05.871672 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867680    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 17:45:05.871672 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867682    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 17:45:05.871672 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867685    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 17:45:05.871672 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867688    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 17:45:05.871672 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867690    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 17:45:05.871672 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867693    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 17:45:05.871672 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867695    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 17:45:05.872178 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867698    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 17:45:05.872178 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867701    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 17:45:05.872178 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867705    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 17:45:05.872178 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867708    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 17:45:05.872178 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867711    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 17:45:05.872178 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867713    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 17:45:05.872178 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867716    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 17:45:05.872178 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867718    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 17:45:05.872178 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867721    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 17:45:05.872178 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867724    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 17:45:05.872178 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867726    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 17:45:05.872178 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867729    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 17:45:05.872178 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867732    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 17:45:05.872178 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867734    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 17:45:05.872178 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867737    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 17:45:05.872178 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867740    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 17:45:05.872178 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867742    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 17:45:05.872178 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867745    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 17:45:05.872178 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.867747    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 17:45:05.872178 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867825    2579 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867866    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867874    2579 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867879    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867884    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867887    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867891    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867896    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867899    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867903    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867907    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867910    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867914    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867917    2579 flags.go:64] FLAG: --cgroup-root=""
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867920    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867923    2579 flags.go:64] FLAG: --client-ca-file=""
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867926    2579 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867929    2579 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867933    2579 flags.go:64] FLAG: --cluster-domain=""
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867936    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867940    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867943    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867947    2579 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867951    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 17:45:05.872742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867954    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867957    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867960    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867963    2579 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867966    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867970    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867973    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867976    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867980    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867983    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867986    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867989    2579 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867992    2579 flags.go:64] FLAG: --enable-server="true"
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.867995    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868000    2579 flags.go:64] FLAG: --event-burst="100"
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868003    2579 flags.go:64] FLAG: --event-qps="50"
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868006    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868009    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868013    2579 flags.go:64] FLAG: --eviction-hard=""
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868017    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868020    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868023    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868026    2579 flags.go:64] FLAG: --eviction-soft=""
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868029    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868032    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 17:45:05.873491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868035    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868037    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868040    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868043    2579 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868046    2579 flags.go:64] FLAG: --feature-gates=""
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868050    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868053    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868056    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868059    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868062    2579 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868065    2579 flags.go:64] FLAG: --help="false"
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868068    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-140-211.ec2.internal"
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868071    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868074    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868077    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868080    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868084    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868087    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868090    2579 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868093    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868096    2579 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868099    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868102    2579 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868105    2579 flags.go:64] FLAG: --kube-reserved=""
Sep 11 17:45:05.874124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868111    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868114    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868117    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868120    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868123    2579 flags.go:64] FLAG: --lock-file=""
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868126    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868129    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868132    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868138    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868141    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868144    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868147    2579 flags.go:64] FLAG: --logging-format="text"
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868150    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868153    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868156    2579 flags.go:64] FLAG: --manifest-url=""
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868159    2579 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868164    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868167    2579 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868171    2579 flags.go:64] FLAG: --max-pods="110"
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868174    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868177    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868180    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868196    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868200    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868203    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 17:45:05.874834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868206    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868214    2579 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868217    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868221    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868224    2579 flags.go:64] FLAG: --pod-cidr=""
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868227    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868235    2579 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868238    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868242    2579 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868245    2579 flags.go:64] FLAG: --port="10250"
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868249    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868252    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c0157832ab9aeb33"
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868255    2579 flags.go:64] FLAG: --qos-reserved=""
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868259    2579 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868262    2579 flags.go:64] FLAG: --register-node="true"
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868264    2579 flags.go:64] FLAG: --register-with-taints=""
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868272    2579 flags.go:64] FLAG: --registry-burst="10"
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868275    2579 flags.go:64] FLAG: --registry-qps="5"
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868278    2579 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868281    2579 flags.go:64] FLAG: --reserved-memory=""
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868285    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868288    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868291    2579 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868294    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868297    2579 flags.go:64] FLAG: --runonce="false"
Sep 11 17:45:05.875502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868300    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868303    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868306    2579 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868309    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868327    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868331    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868334    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868338    2579 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868341    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868343    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868346    2579 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868349    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868352    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868355    2579 flags.go:64] FLAG: --system-cgroups=""
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868358    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868365    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868368    2579 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868371    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868375    2579 flags.go:64] FLAG: --tls-min-version=""
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868378    2579 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868381    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868383    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868386    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868389    2579 flags.go:64] FLAG: --v="2"
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868393    2579 flags.go:64] FLAG: --version="false"
Sep 11 17:45:05.876108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868397    2579 flags.go:64] FLAG: --vmodule=""
Sep 11 17:45:05.876747 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868401    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 17:45:05.876747 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.868404    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 17:45:05.876747 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869835    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 17:45:05.876747 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869853    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 17:45:05.876747 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869859    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 17:45:05.876747 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869864    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 17:45:05.876747 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869872    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 17:45:05.876747 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869879    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 17:45:05.876747 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869884    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 17:45:05.876747 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869889    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 17:45:05.876747 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869894    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 17:45:05.876747 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869900    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 17:45:05.876747 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869905    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 17:45:05.876747 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869909    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 17:45:05.876747 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869914    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 17:45:05.876747 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869918    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 17:45:05.876747 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869923    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 17:45:05.876747 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869927    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 17:45:05.876747 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869932    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 17:45:05.877271 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869936    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 17:45:05.877271 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869940    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 17:45:05.877271 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869945    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 17:45:05.877271 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869949    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 17:45:05.877271 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869953    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 17:45:05.877271 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869959    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 17:45:05.877271 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869963    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 17:45:05.877271 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869969    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 17:45:05.877271 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869974    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 17:45:05.877271 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869979    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 17:45:05.877271 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869983    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 17:45:05.877271 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869987    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 17:45:05.877271 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869992    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 17:45:05.877271 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.869996    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 17:45:05.877271 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870000    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 17:45:05.877271 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870005    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 17:45:05.877271 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870009    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 17:45:05.877271 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870014    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 17:45:05.877271 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870019    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 17:45:05.877809 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870023    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 17:45:05.877809 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870027    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 17:45:05.877809 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870032    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 17:45:05.877809 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870036    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 17:45:05.877809 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870041    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 17:45:05.877809 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870045    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 17:45:05.877809 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870050    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 17:45:05.877809 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870054    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 17:45:05.877809 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870059    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 17:45:05.877809 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870063    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 17:45:05.877809 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870068    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 17:45:05.877809 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870072    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 17:45:05.877809 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870076    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 17:45:05.877809 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870086    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 17:45:05.877809 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870091    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 17:45:05.877809 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870095    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 17:45:05.877809 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870103    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 17:45:05.877809 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870110    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 17:45:05.877809 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870115    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 17:45:05.877809 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870120    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 17:45:05.878346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870124    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 17:45:05.878346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870129    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 17:45:05.878346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870133    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 17:45:05.878346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870137    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 17:45:05.878346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870142    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 17:45:05.878346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870147    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 17:45:05.878346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870151    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 17:45:05.878346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870155    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 17:45:05.878346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870159    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 17:45:05.878346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870164    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 17:45:05.878346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870168    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 17:45:05.878346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870173    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 17:45:05.878346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870177    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 17:45:05.878346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870181    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 17:45:05.878346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870205    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 17:45:05.878346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870210    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 17:45:05.878346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870214    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 17:45:05.878346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870218    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 17:45:05.878346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870222    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 17:45:05.878346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870226    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 17:45:05.878836 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870230    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 17:45:05.878836 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870234    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 17:45:05.878836 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870238    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 17:45:05.878836 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870243    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 17:45:05.878836 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870247    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 17:45:05.878836 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870253    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 17:45:05.878836 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870257    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 17:45:05.878836 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870263    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 17:45:05.878836 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870268    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 17:45:05.878836 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870272    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 17:45:05.878836 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870277    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 17:45:05.878836 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870282    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 17:45:05.878836 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870286    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 17:45:05.878836 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870290    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 17:45:05.878836 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870295    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 17:45:05.878836 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870299    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 17:45:05.878836 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870303    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 17:45:05.878836 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870307    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 17:45:05.878836 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870311    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 17:45:05.878836 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870316    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 17:45:05.879346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870323    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 17:45:05.879346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870328    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 17:45:05.879346 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.870332    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 17:45:05.879346 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.871129    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 17:45:05.879346 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.878936    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 17:45:05.879346 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.878952    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 17:45:05.879845 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.879834    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 17:45:05.879877 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.879849    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 17:45:05.879909 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879904    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 17:45:05.879941 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879910    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 17:45:05.879941 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879913    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 17:45:05.879941 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879917    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 17:45:05.879941 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879919    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 17:45:05.879941 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879922    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 17:45:05.879941 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879925    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 17:45:05.879941 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879928    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 17:45:05.879941 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879930    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 17:45:05.879941 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879933    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 17:45:05.879941 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879936    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 17:45:05.879941 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879939    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 17:45:05.879941 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879942    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 17:45:05.879941 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879945    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 17:45:05.879941 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879948    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 17:45:05.880310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879951    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 17:45:05.880310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879954    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 17:45:05.880310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879957    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 17:45:05.880310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879959    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 17:45:05.880310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879962    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 17:45:05.880310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879965    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 17:45:05.880310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879967    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 17:45:05.880310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879972    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 17:45:05.880310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879975    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 17:45:05.880310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879978    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 17:45:05.880310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879982    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 17:45:05.880310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879984    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 17:45:05.880310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879987    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 17:45:05.880310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879990    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 17:45:05.880310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879993    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 17:45:05.880310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879996    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 17:45:05.880310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.879999    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 17:45:05.880310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880002    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 17:45:05.880310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880004    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 17:45:05.880310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880007    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 17:45:05.880790 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880010    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 17:45:05.880790 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880012    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 17:45:05.880790 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880015    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 17:45:05.880790 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880018    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 17:45:05.880790 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880020    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 17:45:05.880790 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880023    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 17:45:05.880790 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880025    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 17:45:05.880790 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880028    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 17:45:05.880790 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880030    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 17:45:05.880790 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880033    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 17:45:05.880790 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880036    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 17:45:05.880790 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880039    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 17:45:05.880790 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880041    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 17:45:05.880790 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880045    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 17:45:05.880790 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880048    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 17:45:05.880790 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880050    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 17:45:05.880790 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880054    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 17:45:05.880790 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880056    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 17:45:05.880790 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880059    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 17:45:05.880790 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880062    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 17:45:05.881305 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880064    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 17:45:05.881305 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880067    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 17:45:05.881305 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880070    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 17:45:05.881305 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880073    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 17:45:05.881305 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880075    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 17:45:05.881305 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880078    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 17:45:05.881305 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880081    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 17:45:05.881305 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880084    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 17:45:05.881305 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880087    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 17:45:05.881305 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880089    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 17:45:05.881305 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880094    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 17:45:05.881305 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880097    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 17:45:05.881305 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880100    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 17:45:05.881305 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880103    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 17:45:05.881305 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880105    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 17:45:05.881305 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880108    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 17:45:05.881305 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880111    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 17:45:05.881305 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880113    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 17:45:05.881305 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880116    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 17:45:05.881798 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880119    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 17:45:05.881798 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880121    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 17:45:05.881798 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880124    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 17:45:05.881798 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880126    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 17:45:05.881798 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880129    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 17:45:05.881798 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880132    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 17:45:05.881798 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880135    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 17:45:05.881798 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880138    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 17:45:05.881798 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880141    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 17:45:05.881798 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880144    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 17:45:05.881798 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880147    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 17:45:05.881798 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880149    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 17:45:05.881798 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880152    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 17:45:05.881798 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880155    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 17:45:05.881798 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880158    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 17:45:05.881798 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880160    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 17:45:05.881798 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880163    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 17:45:05.881798 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880166    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 17:45:05.881798 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880168    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 17:45:05.881798 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880171    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 17:45:05.882309 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880173    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 17:45:05.882309 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880177    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 17:45:05.882309 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880180    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 17:45:05.882309 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880199    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 17:45:05.882309 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880204    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 17:45:05.882309 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.880209    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 17:45:05.882309 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880323    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 17:45:05.882309 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880327    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 17:45:05.882309 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880331    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 17:45:05.882309 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880333    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 17:45:05.882309 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880337    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 17:45:05.882309 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880339    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 17:45:05.882309 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880342    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 17:45:05.882309 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880345    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 17:45:05.882652 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880348    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 17:45:05.882652 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880350    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 17:45:05.882652 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880353    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 17:45:05.882652 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880356    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 17:45:05.882652 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880358    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 17:45:05.882652 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880362    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 17:45:05.882652 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880365    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 17:45:05.882652 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880367    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 17:45:05.882652 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880370    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 17:45:05.882652 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880373    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 17:45:05.882652 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880375    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 17:45:05.882652 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880378    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 17:45:05.882652 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880380    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 17:45:05.882652 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880383    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 17:45:05.882652 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880386    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 17:45:05.882652 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880389    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 17:45:05.882652 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880391    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 17:45:05.882652 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880394    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 17:45:05.882652 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880398    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 17:45:05.882652 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880401    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 17:45:05.883128 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880404    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 17:45:05.883128 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880407    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 17:45:05.883128 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880410    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 17:45:05.883128 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880412    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 17:45:05.883128 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880415    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 17:45:05.883128 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880417    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 17:45:05.883128 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880420    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 17:45:05.883128 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880422    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 17:45:05.883128 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880425    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 17:45:05.883128 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880428    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 17:45:05.883128 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880430    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 17:45:05.883128 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880433    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 17:45:05.883128 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880435    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 17:45:05.883128 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880438    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 17:45:05.883128 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880441    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 17:45:05.883128 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880443    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 17:45:05.883128 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880446    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 17:45:05.883128 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880448    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 17:45:05.883128 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880451    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 17:45:05.883128 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880454    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 17:45:05.884553 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880456    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 17:45:05.884553 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880459    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 17:45:05.884553 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880462    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 17:45:05.884553 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880464    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 17:45:05.884553 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880467    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 17:45:05.884553 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880469    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 17:45:05.884553 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880472    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 17:45:05.884553 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880474    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 17:45:05.884553 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880477    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 17:45:05.884553 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880479    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 17:45:05.884553 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880482    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 17:45:05.884553 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880484    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 17:45:05.884553 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880487    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 17:45:05.884553 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880491    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 17:45:05.884553 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880494    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 17:45:05.884553 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880496    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 17:45:05.884553 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880499    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 17:45:05.884553 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880501    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 17:45:05.884553 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880504    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 17:45:05.884553 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880506    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 17:45:05.885025 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880509    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 17:45:05.885025 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880512    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 17:45:05.885025 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880514    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 17:45:05.885025 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880518    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 17:45:05.885025 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880521    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 17:45:05.885025 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880524    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 17:45:05.885025 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880527    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 17:45:05.885025 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880530    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 17:45:05.885025 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880533    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 17:45:05.885025 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880536    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 17:45:05.885025 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880539    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 17:45:05.885025 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880542    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 17:45:05.885025 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880544    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 17:45:05.885025 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880547    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 17:45:05.885025 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880549    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 17:45:05.885025 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880552    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 17:45:05.885025 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880554    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 17:45:05.885025 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880557    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 17:45:05.885025 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880559    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 17:45:05.885493 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880562    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 17:45:05.885493 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880564    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 17:45:05.885493 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880567    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 17:45:05.885493 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880569    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 17:45:05.885493 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880572    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 17:45:05.885493 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880574    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 17:45:05.885493 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880577    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 17:45:05.885493 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880580    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 17:45:05.885493 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880583    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 17:45:05.885493 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880586    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 17:45:05.885493 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880590    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 17:45:05.885493 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:05.880592    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 17:45:05.885493 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.880598    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 17:45:05.885493 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.880701    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 17:45:05.885840 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.883005    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 17:45:05.885840 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.884085    2579 server.go:1019] "Starting client certificate rotation"
Sep 11 17:45:05.885840 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.884196    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 17:45:05.885840 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.884232    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 17:45:05.886984 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.886971    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 17:45:05.888139 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.888120    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 17:45:05.901559 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.901538    2579 log.go:25] "Validated CRI v1 runtime API"
Sep 11 17:45:05.907624 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.907603    2579 log.go:25] "Validated CRI v1 image API"
Sep 11 17:45:05.908536 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.908522    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 17:45:05.912451 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.912429    2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e42a5ac7-bacb-4c4d-966f-f84cf8859d85:/dev/nvme0n1p4 e4e9b588-8a4d-4686-8806-8bed33987f28:/dev/nvme0n1p3]
Sep 11 17:45:05.912534 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.912450    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 17:45:05.918800 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.918677    2579 manager.go:216] Machine: {Timestamp:2026-09-11 17:45:05.9171556 +0000 UTC m=+0.310679835 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3079888 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ed04545b389d6eac4c2354452f974 SystemUUID:ec2ed045-45b3-89d6-eac4-c2354452f974 BootID:f7112768-f699-4356-a5d6-5b199efefd6e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:68:9a:f1:53:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:68:9a:f1:53:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:19:9a:62:6e:58 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 17:45:05.918800 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.918787    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 17:45:05.918965 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.918902    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 17:45:05.919391 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.919374    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 17:45:05.922743 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.922714    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 17:45:05.922915 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.922745    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-211.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 17:45:05.923697 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.923687    2579 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 17:45:05.923736 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.923699    2579 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 17:45:05.923736 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.923707    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 17:45:05.924521 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.924509    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 17:45:05.925862 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.925850    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 17:45:05.929652 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.929640    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 17:45:05.929771 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.929761    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 17:45:05.929807 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.929791    2579 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 17:45:05.929807 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.929801    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 17:45:05.929860 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.929814    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 17:45:05.929860 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.929823    2579 kubelet.go:398] "Adding apiserver pod source"
Sep 11 17:45:05.929860 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.929833    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 17:45:05.930215 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.930204    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 17:45:05.930271 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.930223    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 17:45:05.932759 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.932730    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 17:45:05.935705 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.935691    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 17:45:05.935773 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.935721    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 17:45:05.937840 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.937826    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 17:45:05.937910 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.937846    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 17:45:05.937910 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.937856    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 17:45:05.937910 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.937863    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 17:45:05.937910 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.937871    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 17:45:05.937910 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.937878    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 17:45:05.937910 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.937891    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 17:45:05.937910 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.937896    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 17:45:05.937910 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.937903    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 17:45:05.937910 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.937908    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 17:45:05.938144 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.937917    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 17:45:05.938144 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.937922    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 17:45:05.939714 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.939703    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 17:45:05.939755 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.939714    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 17:45:05.943655 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:05.943625    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-211.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 17:45:05.943749 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.943710    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-211.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 17:45:05.943797 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:05.943779    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 17:45:05.943910 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.943877    2579 server.go:1268] "Started kubelet"
Sep 11 17:45:05.943970 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.943934    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 17:45:05.944082 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.944025    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 17:45:05.944172 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.944103    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 17:45:05.944803 ip-10-0-140-211 systemd[1]: Started Kubernetes Kubelet.
Sep 11 17:45:05.945626 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.945607    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 17:45:05.947081 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.947064    2579 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 17:45:05.948618 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:05.948600    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 17:45:05.952668 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.952646    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 17:45:05.953393 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.953371    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 17:45:05.954429 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:05.953546    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-211.ec2.internal\" not found"
Sep 11 17:45:05.954553 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.954375    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 17:45:05.954607 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.954558    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 17:45:05.954733 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.954714    2579 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 17:45:05.954854 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.954843    2579 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 17:45:05.955018 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.955002    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 17:45:05.955477 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.955453    2579 factory.go:55] Registering systemd factory
Sep 11 17:45:05.955477 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.955474    2579 factory.go:223] Registration of the systemd container factory successfully
Sep 11 17:45:05.955856 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.955841    2579 factory.go:153] Registering CRI-O factory
Sep 11 17:45:05.955928 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.955859    2579 factory.go:223] Registration of the crio container factory successfully
Sep 11 17:45:05.955928 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.955921    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 17:45:05.956031 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.955984    2579 factory.go:103] Registering Raw factory
Sep 11 17:45:05.956031 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.956027    2579 manager.go:1196] Started watching for new ooms in manager
Sep 11 17:45:05.956683 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.956613    2579 manager.go:349] Starting recovery of all containers
Sep 11 17:45:05.961841 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:05.961816    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-211.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 17:45:05.962125 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:05.961936    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 17:45:05.963975 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:05.962298    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-211.ec2.internal.18d45544cc21deef  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-211.ec2.internal,UID:ip-10-0-140-211.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-211.ec2.internal,},FirstTimestamp:2026-09-11 17:45:05.943838447 +0000 UTC m=+0.337362644,LastTimestamp:2026-09-11 17:45:05.943838447 +0000 UTC m=+0.337362644,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-211.ec2.internal,}"
Sep 11 17:45:05.967636 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.967605    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 17:45:05.967710 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.967671    2579 manager.go:354] Recovery completed
Sep 11 17:45:05.972660 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.972647    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:45:05.974529 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.974502    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:45:05.974596 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.974539    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:45:05.974596 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.974549    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:45:05.975091 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.975077    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 17:45:05.975144 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.975092    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 17:45:05.975144 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.975107    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 17:45:05.975144 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.975141    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:45:05.975899 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.975886    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:45:05.975952 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.975913    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:45:05.975952 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.975925    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:45:05.976299 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.976287    2579 policy_none.go:49] "None policy: Start"
Sep 11 17:45:05.976345 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.976302    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 17:45:05.976345 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.976312    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 17:45:05.977329 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:05.977317    2579 policy_none.go:47] "Start"
Sep 11 17:45:05.977389 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:05.977254    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-211.ec2.internal.18d45544cdf62668  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-211.ec2.internal,UID:ip-10-0-140-211.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-211.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-211.ec2.internal,},FirstTimestamp:2026-09-11 17:45:05.974527592 +0000 UTC m=+0.368051788,LastTimestamp:2026-09-11 17:45:05.974527592 +0000 UTC m=+0.368051788,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-211.ec2.internal,}"
Sep 11 17:45:05.991513 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:05.991436    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-211.ec2.internal.18d45544cdf667a2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-211.ec2.internal,UID:ip-10-0-140-211.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-211.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-211.ec2.internal,},FirstTimestamp:2026-09-11 17:45:05.97454429 +0000 UTC m=+0.368068490,LastTimestamp:2026-09-11 17:45:05.97454429 +0000 UTC m=+0.368068490,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-211.ec2.internal,}"
Sep 11 17:45:06.002618 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:06.002533    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-211.ec2.internal.18d45544cdf68a8d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-211.ec2.internal,UID:ip-10-0-140-211.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-211.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-211.ec2.internal,},FirstTimestamp:2026-09-11 17:45:05.974553229 +0000 UTC m=+0.368077427,LastTimestamp:2026-09-11 17:45:05.974553229 +0000 UTC m=+0.368077427,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-211.ec2.internal,}"
Sep 11 17:45:06.003293 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.003275    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nfcz9"
Sep 11 17:45:06.011777 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.011764    2579 manager.go:337] "Starting Device Plugin manager"
Sep 11 17:45:06.011857 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:06.011797    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 17:45:06.011857 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.011806    2579 server.go:87] "Starting device plugin registration server"
Sep 11 17:45:06.012178 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.012165    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 17:45:06.012366 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.012182    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 17:45:06.013242 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.012574    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 17:45:06.013242 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.012637    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 17:45:06.013242 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.012660    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 17:45:06.013242 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:06.013164    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 17:45:06.013242 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:06.013219    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-211.ec2.internal\" not found"
Sep 11 17:45:06.013963 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.013945    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nfcz9"
Sep 11 17:45:06.015527 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:06.015461    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-211.ec2.internal.18d45544cdf62668\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-211.ec2.internal.18d45544cdf62668  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-211.ec2.internal,UID:ip-10-0-140-211.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-211.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-211.ec2.internal,},FirstTimestamp:2026-09-11 17:45:05.974527592 +0000 UTC m=+0.368051788,LastTimestamp:2026-09-11 17:45:05.97590001 +0000 UTC m=+0.369424213,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-211.ec2.internal,}"
Sep 11 17:45:06.059663 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.059635    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 17:45:06.059787 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.059690    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 17:45:06.059787 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.059713    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 17:45:06.059787 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:06.059755    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 17:45:06.062086 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.062060    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 17:45:06.112844 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.112765    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:45:06.113794 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.113775    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:45:06.113882 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.113807    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:45:06.113882 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.113818    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:45:06.113882 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.113845    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-211.ec2.internal"
Sep 11 17:45:06.119981 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.119961    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-211.ec2.internal"
Sep 11 17:45:06.119981 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:06.119983    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-211.ec2.internal\": node \"ip-10-0-140-211.ec2.internal\" not found"
Sep 11 17:45:06.138825 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:06.138805    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-211.ec2.internal\" not found"
Sep 11 17:45:06.160764 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.160744    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-211.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-211.ec2.internal"]
Sep 11 17:45:06.160849 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.160801    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:45:06.161624 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.161607    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:45:06.161721 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.161635    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:45:06.161721 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.161644    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:45:06.162960 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.162948    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:45:06.163078 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.163063    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-211.ec2.internal"
Sep 11 17:45:06.163145 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.163100    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:45:06.163664 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.163648    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:45:06.163753 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.163676    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:45:06.163753 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.163690    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:45:06.164537 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.164522    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:45:06.164605 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.164546    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:45:06.164605 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.164558    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:45:06.166114 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.166099    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-211.ec2.internal"
Sep 11 17:45:06.166163 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.166130    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:45:06.166839 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.166823    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:45:06.166898 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.166847    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:45:06.166898 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.166856    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:45:06.192900 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:06.192879    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-211.ec2.internal\" not found" node="ip-10-0-140-211.ec2.internal"
Sep 11 17:45:06.196104 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:06.196090    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-211.ec2.internal\" not found" node="ip-10-0-140-211.ec2.internal"
Sep 11 17:45:06.239881 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:06.239855    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-211.ec2.internal\" not found"
Sep 11 17:45:06.257237 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.257220    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42033061b2efc1a5de4a9db1dfbac058-config\") pod \"kube-apiserver-proxy-ip-10-0-140-211.ec2.internal\" (UID: \"42033061b2efc1a5de4a9db1dfbac058\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-211.ec2.internal"
Sep 11 17:45:06.257315 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.257245    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/68fca22effbed069bcacb26330a72d8f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-211.ec2.internal\" (UID: \"68fca22effbed069bcacb26330a72d8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-211.ec2.internal"
Sep 11 17:45:06.257315 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.257262    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68fca22effbed069bcacb26330a72d8f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-211.ec2.internal\" (UID: \"68fca22effbed069bcacb26330a72d8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-211.ec2.internal"
Sep 11 17:45:06.340968 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:06.340943    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-211.ec2.internal\" not found"
Sep 11 17:45:06.357632 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.357607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42033061b2efc1a5de4a9db1dfbac058-config\") pod \"kube-apiserver-proxy-ip-10-0-140-211.ec2.internal\" (UID: \"42033061b2efc1a5de4a9db1dfbac058\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-211.ec2.internal"
Sep 11 17:45:06.357742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.357637    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/68fca22effbed069bcacb26330a72d8f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-211.ec2.internal\" (UID: \"68fca22effbed069bcacb26330a72d8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-211.ec2.internal"
Sep 11 17:45:06.357742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.357656    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68fca22effbed069bcacb26330a72d8f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-211.ec2.internal\" (UID: \"68fca22effbed069bcacb26330a72d8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-211.ec2.internal"
Sep 11 17:45:06.357742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.357728    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42033061b2efc1a5de4a9db1dfbac058-config\") pod \"kube-apiserver-proxy-ip-10-0-140-211.ec2.internal\" (UID: \"42033061b2efc1a5de4a9db1dfbac058\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-211.ec2.internal"
Sep 11 17:45:06.357844 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.357741    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/68fca22effbed069bcacb26330a72d8f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-211.ec2.internal\" (UID: \"68fca22effbed069bcacb26330a72d8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-211.ec2.internal"
Sep 11 17:45:06.357844 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.357777    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68fca22effbed069bcacb26330a72d8f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-211.ec2.internal\" (UID: \"68fca22effbed069bcacb26330a72d8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-211.ec2.internal"
Sep 11 17:45:06.441614 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:06.441535    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-211.ec2.internal\" not found"
Sep 11 17:45:06.495092 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.495061    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-211.ec2.internal"
Sep 11 17:45:06.498926 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.498618    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-211.ec2.internal"
Sep 11 17:45:06.541670 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:06.541633    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-211.ec2.internal\" not found"
Sep 11 17:45:06.642248 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:06.642210    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-211.ec2.internal\" not found"
Sep 11 17:45:06.742739 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:06.742672    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-211.ec2.internal\" not found"
Sep 11 17:45:06.758894 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:06.758870    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 17:45:06.843026 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:06.842990    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-211.ec2.internal\" not found"
Sep 11 17:45:08.351044 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:08.351018    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 17:45:08.351470 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:08.351136    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 17:45:08.351470 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:08.351184    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 17:45:08.411456 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:08.411423    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-211.ec2.internal\" not found"
Sep 11 17:45:08.486386 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:08.486300    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 17:40:07 +0000 UTC" deadline="2028-03-19 14:04:50.206236301 +0000 UTC"
Sep 11 17:45:08.486386 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:08.486332    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13316h19m41.7199076s"
Sep 11 17:45:08.493466 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:08.493438    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 17:45:08.512238 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:08.512207    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-211.ec2.internal\" not found"
Sep 11 17:45:08.562541 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:08.562516    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:45:08.564088 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:08.564071    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:45:08.564174 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:08.564101    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:45:08.564174 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:08.564111    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:45:08.613055 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:08.613029    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-211.ec2.internal\" not found"
Sep 11 17:45:08.677789 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:08.677727    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42033061b2efc1a5de4a9db1dfbac058.slice/crio-ff72049a1b8faccce4c4ba9463fa6fe150273b0b2382157c350a3dc08f577353 WatchSource:0}: Error finding container ff72049a1b8faccce4c4ba9463fa6fe150273b0b2382157c350a3dc08f577353: Status 404 returned error can't find the container with id ff72049a1b8faccce4c4ba9463fa6fe150273b0b2382157c350a3dc08f577353
Sep 11 17:45:08.680931 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:08.680915    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 17:45:08.681780 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:08.681745    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 17:45:08.722886 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:08.722864    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-211.ec2.internal"
Sep 11 17:45:08.730640 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:08.730618    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 17:45:08.732870 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:08.732857    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-211.ec2.internal"
Sep 11 17:45:08.745126 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:08.745073    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 17:45:08.747805 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:08.747784    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68fca22effbed069bcacb26330a72d8f.slice/crio-217ce6977aa26da923b445c8083c3abe076e28145c63cbffe4dad07606267f9d WatchSource:0}: Error finding container 217ce6977aa26da923b445c8083c3abe076e28145c63cbffe4dad07606267f9d: Status 404 returned error can't find the container with id 217ce6977aa26da923b445c8083c3abe076e28145c63cbffe4dad07606267f9d
Sep 11 17:45:09.399110 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.399080    2579 apiserver.go:52] "Watching apiserver"
Sep 11 17:45:09.405159 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.404848    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 17:45:09.407396 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.407368    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-fzfxg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m","openshift-cluster-node-tuning-operator/tuned-szj28","openshift-dns/node-resolver-m8n8w","openshift-multus/multus-additional-cni-plugins-hg88l","openshift-multus/network-metrics-daemon-27scn","openshift-network-diagnostics/network-check-target-hjngm","openshift-network-operator/iptables-alerter-b459q","kube-system/konnectivity-agent-tvgkk","kube-system/kube-apiserver-proxy-ip-10-0-140-211.ec2.internal","openshift-image-registry/node-ca-6pqzm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-211.ec2.internal","openshift-multus/multus-6h9cq","openshift-ovn-kubernetes/ovnkube-node-l7zx6"]
Sep 11 17:45:09.410089 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.410071    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:09.410181 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:09.410151    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjngm" podUID="ca5eeb84-ac64-4191-8943-67fb065f9d90"
Sep 11 17:45:09.412245 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.412225    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.415782 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.414647    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jj85b\""
Sep 11 17:45:09.419656 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.416050    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 17:45:09.419656 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.416736    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 17:45:09.419656 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.417147    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 17:45:09.419656 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.417344    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 17:45:09.419656 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.417724    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.419656 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.418808    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m8n8w"
Sep 11 17:45:09.420708 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.420689    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 17:45:09.420901 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.420858    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 17:45:09.421018 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.420998    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.421589 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.421568    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6q9p6\""
Sep 11 17:45:09.421694 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.421674    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f6kk2\""
Sep 11 17:45:09.422473 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.422323    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 17:45:09.424423 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.424404    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:09.424495 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:09.424468    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27scn" podUID="ebc8fd61-b671-4d9e-9e23-756caf55b43c"
Sep 11 17:45:09.424578 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.424560    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 17:45:09.426600 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.426318    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tvgkk"
Sep 11 17:45:09.426930 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.426914    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 17:45:09.428649 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.428463    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:09.428649 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:09.428537    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzfxg" podUID="74532c4c-1206-4467-90af-b6dca8c3b5ac"
Sep 11 17:45:09.428796 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.428719    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 17:45:09.428858 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.428814    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 17:45:09.429070 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.429044    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 17:45:09.429143 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.429105    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k8r4w\""
Sep 11 17:45:09.429428 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.429411    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8bgjb\""
Sep 11 17:45:09.429611 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.429588    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 17:45:09.430796 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.430778    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.432937 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.432906    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-lib-modules\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.433032 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.432939    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/042f7b83-4c39-4ad8-a46b-17acc4753970-etc-tuned\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.433032 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.432964    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t74gf\" (UniqueName: \"kubernetes.io/projected/042f7b83-4c39-4ad8-a46b-17acc4753970-kube-api-access-t74gf\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.433032 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433015    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jgz9\" (UniqueName: \"kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9\") pod \"network-check-target-hjngm\" (UID: \"ca5eeb84-ac64-4191-8943-67fb065f9d90\") " pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:09.433207 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433057    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-host-run-netns\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.433207 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433084    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-etc-kubernetes\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.433207 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433123    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-etc-sysctl-conf\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.433207 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433148    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-host\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.433207 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433174    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c48582c7-77a6-40c2-b187-de7038c31e1f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hg88l\" (UID: \"c48582c7-77a6-40c2-b187-de7038c31e1f\") " pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.433466 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433200    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nndzt\" (UniqueName: \"kubernetes.io/projected/ebc8fd61-b671-4d9e-9e23-756caf55b43c-kube-api-access-nndzt\") pod \"network-metrics-daemon-27scn\" (UID: \"ebc8fd61-b671-4d9e-9e23-756caf55b43c\") " pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:09.433466 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433269    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2cbcf37c-4462-4774-b2b9-cae117204cda-multus-daemon-config\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.433466 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433305    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc2786c3-ff15-4108-b6df-ef1852972821-hosts-file\") pod \"node-resolver-m8n8w\" (UID: \"bc2786c3-ff15-4108-b6df-ef1852972821\") " pod="openshift-dns/node-resolver-m8n8w"
Sep 11 17:45:09.433466 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433365    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 17:45:09.433466 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433348    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbnbp\" (UniqueName: \"kubernetes.io/projected/bc2786c3-ff15-4108-b6df-ef1852972821-kube-api-access-mbnbp\") pod \"node-resolver-m8n8w\" (UID: \"bc2786c3-ff15-4108-b6df-ef1852972821\") " pod="openshift-dns/node-resolver-m8n8w"
Sep 11 17:45:09.433466 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433415    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c48582c7-77a6-40c2-b187-de7038c31e1f-cnibin\") pod \"multus-additional-cni-plugins-hg88l\" (UID: \"c48582c7-77a6-40c2-b187-de7038c31e1f\") " pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.433466 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433440    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c48582c7-77a6-40c2-b187-de7038c31e1f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hg88l\" (UID: \"c48582c7-77a6-40c2-b187-de7038c31e1f\") " pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.433466 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433465    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-host-run-multus-certs\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.433980 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433468    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 17:45:09.433980 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433512    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-etc-kubernetes\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.433980 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433556    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-etc-systemd\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.433980 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433578    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2cbcf37c-4462-4774-b2b9-cae117204cda-cni-binary-copy\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.433980 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433601    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-host-var-lib-kubelet\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.433980 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433626    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc2786c3-ff15-4108-b6df-ef1852972821-tmp-dir\") pod \"node-resolver-m8n8w\" (UID: \"bc2786c3-ff15-4108-b6df-ef1852972821\") " pod="openshift-dns/node-resolver-m8n8w"
Sep 11 17:45:09.433980 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433649    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c48582c7-77a6-40c2-b187-de7038c31e1f-cni-binary-copy\") pod \"multus-additional-cni-plugins-hg88l\" (UID: \"c48582c7-77a6-40c2-b187-de7038c31e1f\") " pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.433980 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433680    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 17:45:09.433980 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433675    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-multus-cni-dir\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.433980 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433731    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jdmvx\""
Sep 11 17:45:09.433980 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433752    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-run\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.433980 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433794    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-sys\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.433980 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433818    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/042f7b83-4c39-4ad8-a46b-17acc4753970-tmp\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.433980 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433873    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzmtg\" (UniqueName: \"kubernetes.io/projected/c48582c7-77a6-40c2-b187-de7038c31e1f-kube-api-access-nzmtg\") pod \"multus-additional-cni-plugins-hg88l\" (UID: \"c48582c7-77a6-40c2-b187-de7038c31e1f\") " pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.433980 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433938    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-system-cni-dir\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.433980 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433973    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.434774 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.433971    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-cnibin\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.434774 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.434112    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-host-var-lib-cni-bin\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.434774 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.434136    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-hostroot\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.434774 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.434157    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-etc-modprobe-d\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.434774 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.434178    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-etc-sysconfig\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.434774 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.434223    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-var-lib-kubelet\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.434774 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.434275    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-multus-socket-dir-parent\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.434774 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.434311    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-host-var-lib-cni-multus\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.434774 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.434352    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6vrx\" (UniqueName: \"kubernetes.io/projected/2cbcf37c-4462-4774-b2b9-cae117204cda-kube-api-access-z6vrx\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.434774 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.434376    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-etc-sysctl-d\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.434774 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.434398    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c48582c7-77a6-40c2-b187-de7038c31e1f-system-cni-dir\") pod \"multus-additional-cni-plugins-hg88l\" (UID: \"c48582c7-77a6-40c2-b187-de7038c31e1f\") " pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.434774 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.434433    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c48582c7-77a6-40c2-b187-de7038c31e1f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hg88l\" (UID: \"c48582c7-77a6-40c2-b187-de7038c31e1f\") " pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.434774 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.434472    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs\") pod \"network-metrics-daemon-27scn\" (UID: \"ebc8fd61-b671-4d9e-9e23-756caf55b43c\") " pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:09.434774 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.434516    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-host-run-k8s-cni-cncf-io\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.434774 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.434559    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-multus-conf-dir\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.435569 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.435545    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 17:45:09.436372 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.436117    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 17:45:09.436372 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.436328    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8xgtg\""
Sep 11 17:45:09.436551 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.436512    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6pqzm"
Sep 11 17:45:09.436661 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.436643    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 17:45:09.437110 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.436951    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 17:45:09.438425 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.437866    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 17:45:09.438425 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.438096    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 17:45:09.438425 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.438257    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 17:45:09.439317 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.438655    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b459q"
Sep 11 17:45:09.439724 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.439709    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 17:45:09.440137 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.439914    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 17:45:09.440635 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.440404    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 17:45:09.440635 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.440416    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jtlwp\""
Sep 11 17:45:09.440794 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.440657    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 17:45:09.441527 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.441508    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 17:45:09.442344 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.441688    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 17:45:09.442344 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.442089    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s2bzh\""
Sep 11 17:45:09.466194 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.466169    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 17:45:09.484134 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.484111    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9j4ln"
Sep 11 17:45:09.493479 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.493427    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9j4ln"
Sep 11 17:45:09.524435 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.524398    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 17:45:09.532110 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.532040    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-211.ec2.internal" event={"ID":"68fca22effbed069bcacb26330a72d8f","Type":"ContainerStarted","Data":"217ce6977aa26da923b445c8083c3abe076e28145c63cbffe4dad07606267f9d"}
Sep 11 17:45:09.533485 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.533458    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-211.ec2.internal" event={"ID":"42033061b2efc1a5de4a9db1dfbac058","Type":"ContainerStarted","Data":"ff72049a1b8faccce4c4ba9463fa6fe150273b0b2382157c350a3dc08f577353"}
Sep 11 17:45:09.534730 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.534704    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/73e0fe43-f7e6-4418-b6c2-2f26221c994d-serviceca\") pod \"node-ca-6pqzm\" (UID: \"73e0fe43-f7e6-4418-b6c2-2f26221c994d\") " pod="openshift-image-registry/node-ca-6pqzm"
Sep 11 17:45:09.534833 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.534745    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-system-cni-dir\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.534833 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.534786    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-cnibin\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.534833 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.534815    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-etc-modprobe-d\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.534987 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.534838    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-var-lib-kubelet\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.534987 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.534862    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-host-run-ovn-kubernetes\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.534987 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.534886    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6vrx\" (UniqueName: \"kubernetes.io/projected/2cbcf37c-4462-4774-b2b9-cae117204cda-kube-api-access-z6vrx\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.534987 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.534907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-etc-sysctl-d\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.534987 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.534922    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-system-cni-dir\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.534987 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.534932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c48582c7-77a6-40c2-b187-de7038c31e1f-system-cni-dir\") pod \"multus-additional-cni-plugins-hg88l\" (UID: \"c48582c7-77a6-40c2-b187-de7038c31e1f\") " pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.534987 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.534953    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-cnibin\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.534987 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.534956    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c48582c7-77a6-40c2-b187-de7038c31e1f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hg88l\" (UID: \"c48582c7-77a6-40c2-b187-de7038c31e1f\") " pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.535390 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535000    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-etc-modprobe-d\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.535390 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535002    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs\") pod \"network-metrics-daemon-27scn\" (UID: \"ebc8fd61-b671-4d9e-9e23-756caf55b43c\") " pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:09.535390 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535005    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-var-lib-kubelet\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.535390 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:09.535066    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:09.535390 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535114    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-etc-sysctl-d\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.535390 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:09.535123    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs podName:ebc8fd61-b671-4d9e-9e23-756caf55b43c nodeName:}" failed. No retries permitted until 2026-09-11 17:45:10.035103638 +0000 UTC m=+2.961055387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs") pod "network-metrics-daemon-27scn" (UID: "ebc8fd61-b671-4d9e-9e23-756caf55b43c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:09.535390 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535149    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-ovnkube-script-lib\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.535390 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-multus-conf-dir\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.535390 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535218    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t74gf\" (UniqueName: \"kubernetes.io/projected/042f7b83-4c39-4ad8-a46b-17acc4753970-kube-api-access-t74gf\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.535390 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535237    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c48582c7-77a6-40c2-b187-de7038c31e1f-system-cni-dir\") pod \"multus-additional-cni-plugins-hg88l\" (UID: \"c48582c7-77a6-40c2-b187-de7038c31e1f\") " pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.535390 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535253    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jgz9\" (UniqueName: \"kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9\") pod \"network-check-target-hjngm\" (UID: \"ca5eeb84-ac64-4191-8943-67fb065f9d90\") " pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:09.535390 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535262    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-multus-conf-dir\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.535390 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535277    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-host-run-netns\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.535390 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535303    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nndzt\" (UniqueName: \"kubernetes.io/projected/ebc8fd61-b671-4d9e-9e23-756caf55b43c-kube-api-access-nndzt\") pod \"network-metrics-daemon-27scn\" (UID: \"ebc8fd61-b671-4d9e-9e23-756caf55b43c\") " pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:09.535390 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535327    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-node-log\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.535390 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535350    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-host-cni-bin\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.535390 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535378    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2cbcf37c-4462-4774-b2b9-cae117204cda-multus-daemon-config\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.536135 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535406    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc2786c3-ff15-4108-b6df-ef1852972821-hosts-file\") pod \"node-resolver-m8n8w\" (UID: \"bc2786c3-ff15-4108-b6df-ef1852972821\") " pod="openshift-dns/node-resolver-m8n8w"
Sep 11 17:45:09.536135 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535430    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-log-socket\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.536135 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535459    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-host-run-netns\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.536135 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535462    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-ovn-node-metrics-cert\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.536135 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535504    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-host-run-multus-certs\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.536135 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535523    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c48582c7-77a6-40c2-b187-de7038c31e1f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hg88l\" (UID: \"c48582c7-77a6-40c2-b187-de7038c31e1f\") " pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.536135 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535534    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-etc-kubernetes\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.536135 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535541    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc2786c3-ff15-4108-b6df-ef1852972821-hosts-file\") pod \"node-resolver-m8n8w\" (UID: \"bc2786c3-ff15-4108-b6df-ef1852972821\") " pod="openshift-dns/node-resolver-m8n8w"
Sep 11 17:45:09.536135 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535573    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-host-run-multus-certs\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.536135 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535577    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-run-openvswitch\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.536135 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535575    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-etc-kubernetes\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.536135 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535609    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw4l7\" (UniqueName: \"kubernetes.io/projected/48622241-45bc-48f3-97fc-3e4668889c15-kube-api-access-zw4l7\") pod \"iptables-alerter-b459q\" (UID: \"48622241-45bc-48f3-97fc-3e4668889c15\") " pod="openshift-network-operator/iptables-alerter-b459q"
Sep 11 17:45:09.536135 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535635    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2cbcf37c-4462-4774-b2b9-cae117204cda-cni-binary-copy\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.536135 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc2786c3-ff15-4108-b6df-ef1852972821-tmp-dir\") pod \"node-resolver-m8n8w\" (UID: \"bc2786c3-ff15-4108-b6df-ef1852972821\") " pod="openshift-dns/node-resolver-m8n8w"
Sep 11 17:45:09.536135 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535679    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-systemd-units\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.536135 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.535712    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/042f7b83-4c39-4ad8-a46b-17acc4753970-tmp\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.536135 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536038    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc2786c3-ff15-4108-b6df-ef1852972821-tmp-dir\") pod \"node-resolver-m8n8w\" (UID: \"bc2786c3-ff15-4108-b6df-ef1852972821\") " pod="openshift-dns/node-resolver-m8n8w"
Sep 11 17:45:09.536865 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536035    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2cbcf37c-4462-4774-b2b9-cae117204cda-multus-daemon-config\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.536865 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536074    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5a40983e-4ca5-4166-93c0-30f9432dbfbf-konnectivity-ca\") pod \"konnectivity-agent-tvgkk\" (UID: \"5a40983e-4ca5-4166-93c0-30f9432dbfbf\") " pod="kube-system/konnectivity-agent-tvgkk"
Sep 11 17:45:09.536865 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536105    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7m8w\" (UniqueName: \"kubernetes.io/projected/dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0-kube-api-access-q7m8w\") pod \"aws-ebs-csi-driver-node-bhj9m\" (UID: \"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.536865 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536154    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-host-run-netns\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.536865 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536188    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-run-systemd\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.536865 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536224    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-host-var-lib-cni-bin\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.536865 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536263    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-host-var-lib-cni-bin\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.536865 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536293    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-hostroot\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.536865 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536333    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-etc-sysconfig\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.536865 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536359    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0-sys-fs\") pod \"aws-ebs-csi-driver-node-bhj9m\" (UID: \"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.536865 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536385    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 17:45:09.536865 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536406    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-etc-sysconfig\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.536865 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536434    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-multus-socket-dir-parent\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.536865 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536457    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-host-var-lib-cni-multus\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.536865 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536480    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-bhj9m\" (UID: \"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.536865 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536512    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-host-var-lib-cni-multus\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.536865 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536538    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-run-ovn\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.537719 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536572    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/48622241-45bc-48f3-97fc-3e4668889c15-iptables-alerter-script\") pod \"iptables-alerter-b459q\" (UID: \"48622241-45bc-48f3-97fc-3e4668889c15\") " pod="openshift-network-operator/iptables-alerter-b459q"
Sep 11 17:45:09.537719 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536601    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-host-run-k8s-cni-cncf-io\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.537719 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536623    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-lib-modules\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.537719 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536647    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/042f7b83-4c39-4ad8-a46b-17acc4753970-etc-tuned\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.537719 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536736    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2cbcf37c-4462-4774-b2b9-cae117204cda-cni-binary-copy\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.537719 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536733    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-hostroot\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.537719 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536789    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/74532c4c-1206-4467-90af-b6dca8c3b5ac-dbus\") pod \"global-pull-secret-syncer-fzfxg\" (UID: \"74532c4c-1206-4467-90af-b6dca8c3b5ac\") " pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:09.537719 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536817    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5a40983e-4ca5-4166-93c0-30f9432dbfbf-agent-certs\") pod \"konnectivity-agent-tvgkk\" (UID: \"5a40983e-4ca5-4166-93c0-30f9432dbfbf\") " pod="kube-system/konnectivity-agent-tvgkk"
Sep 11 17:45:09.537719 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536836    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-multus-socket-dir-parent\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.537719 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536839    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-lib-modules\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.537719 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536840    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48622241-45bc-48f3-97fc-3e4668889c15-host-slash\") pod \"iptables-alerter-b459q\" (UID: \"48622241-45bc-48f3-97fc-3e4668889c15\") " pod="openshift-network-operator/iptables-alerter-b459q"
Sep 11 17:45:09.537719 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536877    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-etc-kubernetes\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.537719 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536900    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-host-run-k8s-cni-cncf-io\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.537719 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536937    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-etc-sysctl-conf\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.537719 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.536961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-host\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.537719 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537003    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-etc-kubernetes\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.537719 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537032    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c48582c7-77a6-40c2-b187-de7038c31e1f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hg88l\" (UID: \"c48582c7-77a6-40c2-b187-de7038c31e1f\") " pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.538505 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537070    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-etc-sysctl-conf\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.538505 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537070    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-host\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.538505 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537105    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret\") pod \"global-pull-secret-syncer-fzfxg\" (UID: \"74532c4c-1206-4467-90af-b6dca8c3b5ac\") " pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:09.538505 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537150    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bhj9m\" (UID: \"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.538505 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537178    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0-socket-dir\") pod \"aws-ebs-csi-driver-node-bhj9m\" (UID: \"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.538505 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537198    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0-registration-dir\") pod \"aws-ebs-csi-driver-node-bhj9m\" (UID: \"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.538505 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537217    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbnbp\" (UniqueName: \"kubernetes.io/projected/bc2786c3-ff15-4108-b6df-ef1852972821-kube-api-access-mbnbp\") pod \"node-resolver-m8n8w\" (UID: \"bc2786c3-ff15-4108-b6df-ef1852972821\") " pod="openshift-dns/node-resolver-m8n8w"
Sep 11 17:45:09.538505 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537240    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c48582c7-77a6-40c2-b187-de7038c31e1f-cnibin\") pod \"multus-additional-cni-plugins-hg88l\" (UID: \"c48582c7-77a6-40c2-b187-de7038c31e1f\") " pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.538505 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537294    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c48582c7-77a6-40c2-b187-de7038c31e1f-cnibin\") pod \"multus-additional-cni-plugins-hg88l\" (UID: \"c48582c7-77a6-40c2-b187-de7038c31e1f\") " pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.538505 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537324    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c48582c7-77a6-40c2-b187-de7038c31e1f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hg88l\" (UID: \"c48582c7-77a6-40c2-b187-de7038c31e1f\") " pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.538505 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537350    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-host-kubelet\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.538505 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537373    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-host-slash\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.538505 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537396    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-etc-openvswitch\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.538505 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537430    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.538505 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537436    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c48582c7-77a6-40c2-b187-de7038c31e1f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hg88l\" (UID: \"c48582c7-77a6-40c2-b187-de7038c31e1f\") " pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.538505 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537464    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-ovnkube-config\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.539276 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537492    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-etc-systemd\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.539276 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537517    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/74532c4c-1206-4467-90af-b6dca8c3b5ac-kubelet-config\") pod \"global-pull-secret-syncer-fzfxg\" (UID: \"74532c4c-1206-4467-90af-b6dca8c3b5ac\") " pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:09.539276 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537549    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-host-var-lib-kubelet\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.539276 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537574    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c48582c7-77a6-40c2-b187-de7038c31e1f-cni-binary-copy\") pod \"multus-additional-cni-plugins-hg88l\" (UID: \"c48582c7-77a6-40c2-b187-de7038c31e1f\") " pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.539276 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537596    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c48582c7-77a6-40c2-b187-de7038c31e1f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hg88l\" (UID: \"c48582c7-77a6-40c2-b187-de7038c31e1f\") " pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.539276 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537573    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-etc-systemd\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.539276 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537639    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0-device-dir\") pod \"aws-ebs-csi-driver-node-bhj9m\" (UID: \"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.539276 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537648    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-host-var-lib-kubelet\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.539276 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537686    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-host-cni-netd\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.539276 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537712    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-env-overrides\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.539276 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537748    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq8x7\" (UniqueName: \"kubernetes.io/projected/73e0fe43-f7e6-4418-b6c2-2f26221c994d-kube-api-access-zq8x7\") pod \"node-ca-6pqzm\" (UID: \"73e0fe43-f7e6-4418-b6c2-2f26221c994d\") " pod="openshift-image-registry/node-ca-6pqzm"
Sep 11 17:45:09.539276 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537795    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-multus-cni-dir\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.539276 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537825    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-run\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.539276 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537847    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-sys\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.539276 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537872    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzmtg\" (UniqueName: \"kubernetes.io/projected/c48582c7-77a6-40c2-b187-de7038c31e1f-kube-api-access-nzmtg\") pod \"multus-additional-cni-plugins-hg88l\" (UID: \"c48582c7-77a6-40c2-b187-de7038c31e1f\") " pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.539276 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537888    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-run\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.539276 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537939    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-var-lib-openvswitch\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.540079 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537945    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cbcf37c-4462-4774-b2b9-cae117204cda-multus-cni-dir\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.540079 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537955    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv7jp\" (UniqueName: \"kubernetes.io/projected/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-kube-api-access-vv7jp\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.540079 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.537991    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/042f7b83-4c39-4ad8-a46b-17acc4753970-sys\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.540079 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.538023    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73e0fe43-f7e6-4418-b6c2-2f26221c994d-host\") pod \"node-ca-6pqzm\" (UID: \"73e0fe43-f7e6-4418-b6c2-2f26221c994d\") " pod="openshift-image-registry/node-ca-6pqzm"
Sep 11 17:45:09.540079 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.538040    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c48582c7-77a6-40c2-b187-de7038c31e1f-cni-binary-copy\") pod \"multus-additional-cni-plugins-hg88l\" (UID: \"c48582c7-77a6-40c2-b187-de7038c31e1f\") " pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.541801 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.541727    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/042f7b83-4c39-4ad8-a46b-17acc4753970-tmp\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.542250 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:09.541932    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 17:45:09.542250 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:09.541949    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 17:45:09.542250 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:09.541962    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8jgz9 for pod openshift-network-diagnostics/network-check-target-hjngm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:09.542250 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:09.542017    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9 podName:ca5eeb84-ac64-4191-8943-67fb065f9d90 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:10.041998837 +0000 UTC m=+2.967950566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8jgz9" (UniqueName: "kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9") pod "network-check-target-hjngm" (UID: "ca5eeb84-ac64-4191-8943-67fb065f9d90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:09.542444 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.542328    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/042f7b83-4c39-4ad8-a46b-17acc4753970-etc-tuned\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.544484 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.544456    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t74gf\" (UniqueName: \"kubernetes.io/projected/042f7b83-4c39-4ad8-a46b-17acc4753970-kube-api-access-t74gf\") pod \"tuned-szj28\" (UID: \"042f7b83-4c39-4ad8-a46b-17acc4753970\") " pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.544604 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.544503    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6vrx\" (UniqueName: \"kubernetes.io/projected/2cbcf37c-4462-4774-b2b9-cae117204cda-kube-api-access-z6vrx\") pod \"multus-6h9cq\" (UID: \"2cbcf37c-4462-4774-b2b9-cae117204cda\") " pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.544604 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.544457    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nndzt\" (UniqueName: \"kubernetes.io/projected/ebc8fd61-b671-4d9e-9e23-756caf55b43c-kube-api-access-nndzt\") pod \"network-metrics-daemon-27scn\" (UID: \"ebc8fd61-b671-4d9e-9e23-756caf55b43c\") " pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:09.547688 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.547659    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbnbp\" (UniqueName: \"kubernetes.io/projected/bc2786c3-ff15-4108-b6df-ef1852972821-kube-api-access-mbnbp\") pod \"node-resolver-m8n8w\" (UID: \"bc2786c3-ff15-4108-b6df-ef1852972821\") " pod="openshift-dns/node-resolver-m8n8w"
Sep 11 17:45:09.548594 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.548551    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzmtg\" (UniqueName: \"kubernetes.io/projected/c48582c7-77a6-40c2-b187-de7038c31e1f-kube-api-access-nzmtg\") pod \"multus-additional-cni-plugins-hg88l\" (UID: \"c48582c7-77a6-40c2-b187-de7038c31e1f\") " pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.638436 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638405    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-host-slash\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.638596 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638444    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-etc-openvswitch\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.638596 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638469    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.638596 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638495    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-ovnkube-config\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.638596 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638518    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/74532c4c-1206-4467-90af-b6dca8c3b5ac-kubelet-config\") pod \"global-pull-secret-syncer-fzfxg\" (UID: \"74532c4c-1206-4467-90af-b6dca8c3b5ac\") " pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:09.638596 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638532    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-host-slash\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.638596 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638543    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0-device-dir\") pod \"aws-ebs-csi-driver-node-bhj9m\" (UID: \"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.638596 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638574    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-host-cni-netd\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.638967 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638600    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-env-overrides\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.638967 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638626    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq8x7\" (UniqueName: \"kubernetes.io/projected/73e0fe43-f7e6-4418-b6c2-2f26221c994d-kube-api-access-zq8x7\") pod \"node-ca-6pqzm\" (UID: \"73e0fe43-f7e6-4418-b6c2-2f26221c994d\") " pod="openshift-image-registry/node-ca-6pqzm"
Sep 11 17:45:09.638967 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638660    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.638967 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638661    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-var-lib-openvswitch\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.638967 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638630    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-etc-openvswitch\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.638967 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638716    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv7jp\" (UniqueName: \"kubernetes.io/projected/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-kube-api-access-vv7jp\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.638967 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638600    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0-device-dir\") pod \"aws-ebs-csi-driver-node-bhj9m\" (UID: \"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.638967 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638740    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73e0fe43-f7e6-4418-b6c2-2f26221c994d-host\") pod \"node-ca-6pqzm\" (UID: \"73e0fe43-f7e6-4418-b6c2-2f26221c994d\") " pod="openshift-image-registry/node-ca-6pqzm"
Sep 11 17:45:09.638967 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638745    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/74532c4c-1206-4467-90af-b6dca8c3b5ac-kubelet-config\") pod \"global-pull-secret-syncer-fzfxg\" (UID: \"74532c4c-1206-4467-90af-b6dca8c3b5ac\") " pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:09.638967 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638778    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/73e0fe43-f7e6-4418-b6c2-2f26221c994d-serviceca\") pod \"node-ca-6pqzm\" (UID: \"73e0fe43-f7e6-4418-b6c2-2f26221c994d\") " pod="openshift-image-registry/node-ca-6pqzm"
Sep 11 17:45:09.638967 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638805    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-host-run-ovn-kubernetes\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.638967 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638805    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73e0fe43-f7e6-4418-b6c2-2f26221c994d-host\") pod \"node-ca-6pqzm\" (UID: \"73e0fe43-f7e6-4418-b6c2-2f26221c994d\") " pod="openshift-image-registry/node-ca-6pqzm"
Sep 11 17:45:09.638967 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638870    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-host-run-ovn-kubernetes\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.638967 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638915    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-ovnkube-script-lib\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.638967 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638914    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-var-lib-openvswitch\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.638967 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-node-log\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.638967 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.638974    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-host-cni-netd\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.639731 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639013    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-node-log\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.639731 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639053    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-host-cni-bin\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.639731 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639091    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-log-socket\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.639731 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639117    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-ovn-node-metrics-cert\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.639731 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639174    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-host-cni-bin\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.639731 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639211    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-run-openvswitch\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.639731 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639242    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw4l7\" (UniqueName: \"kubernetes.io/projected/48622241-45bc-48f3-97fc-3e4668889c15-kube-api-access-zw4l7\") pod \"iptables-alerter-b459q\" (UID: \"48622241-45bc-48f3-97fc-3e4668889c15\") " pod="openshift-network-operator/iptables-alerter-b459q"
Sep 11 17:45:09.639731 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639269    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-systemd-units\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.639731 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639279    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-log-socket\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.639731 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639294    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5a40983e-4ca5-4166-93c0-30f9432dbfbf-konnectivity-ca\") pod \"konnectivity-agent-tvgkk\" (UID: \"5a40983e-4ca5-4166-93c0-30f9432dbfbf\") " pod="kube-system/konnectivity-agent-tvgkk"
Sep 11 17:45:09.639731 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7m8w\" (UniqueName: \"kubernetes.io/projected/dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0-kube-api-access-q7m8w\") pod \"aws-ebs-csi-driver-node-bhj9m\" (UID: \"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.639731 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639340    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-host-run-netns\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.639731 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639353    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-ovnkube-config\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.639731 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639365    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-run-systemd\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.639731 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639369    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-env-overrides\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.639731 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639244    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/73e0fe43-f7e6-4418-b6c2-2f26221c994d-serviceca\") pod \"node-ca-6pqzm\" (UID: \"73e0fe43-f7e6-4418-b6c2-2f26221c994d\") " pod="openshift-image-registry/node-ca-6pqzm"
Sep 11 17:45:09.639731 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0-sys-fs\") pod \"aws-ebs-csi-driver-node-bhj9m\" (UID: \"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.640487 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639423    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-run-systemd\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.640487 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639442    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-bhj9m\" (UID: \"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.640487 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639465    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-systemd-units\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.640487 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639494    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-run-ovn\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.640487 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639512    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-ovnkube-script-lib\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.640487 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639526    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-run-openvswitch\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.640487 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639522    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/48622241-45bc-48f3-97fc-3e4668889c15-iptables-alerter-script\") pod \"iptables-alerter-b459q\" (UID: \"48622241-45bc-48f3-97fc-3e4668889c15\") " pod="openshift-network-operator/iptables-alerter-b459q"
Sep 11 17:45:09.640487 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639571    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/74532c4c-1206-4467-90af-b6dca8c3b5ac-dbus\") pod \"global-pull-secret-syncer-fzfxg\" (UID: \"74532c4c-1206-4467-90af-b6dca8c3b5ac\") " pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:09.640487 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639594    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0-sys-fs\") pod \"aws-ebs-csi-driver-node-bhj9m\" (UID: \"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.640487 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639614    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5a40983e-4ca5-4166-93c0-30f9432dbfbf-agent-certs\") pod \"konnectivity-agent-tvgkk\" (UID: \"5a40983e-4ca5-4166-93c0-30f9432dbfbf\") " pod="kube-system/konnectivity-agent-tvgkk"
Sep 11 17:45:09.640487 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639635    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-host-run-netns\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.640487 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639639    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48622241-45bc-48f3-97fc-3e4668889c15-host-slash\") pod \"iptables-alerter-b459q\" (UID: \"48622241-45bc-48f3-97fc-3e4668889c15\") " pod="openshift-network-operator/iptables-alerter-b459q"
Sep 11 17:45:09.640487 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639640    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-bhj9m\" (UID: \"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.640487 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639694    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/74532c4c-1206-4467-90af-b6dca8c3b5ac-dbus\") pod \"global-pull-secret-syncer-fzfxg\" (UID: \"74532c4c-1206-4467-90af-b6dca8c3b5ac\") " pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:09.640487 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639700    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret\") pod \"global-pull-secret-syncer-fzfxg\" (UID: \"74532c4c-1206-4467-90af-b6dca8c3b5ac\") " pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:09.640487 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639725    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bhj9m\" (UID: \"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.640487 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639730    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48622241-45bc-48f3-97fc-3e4668889c15-host-slash\") pod \"iptables-alerter-b459q\" (UID: \"48622241-45bc-48f3-97fc-3e4668889c15\") " pod="openshift-network-operator/iptables-alerter-b459q"
Sep 11 17:45:09.641311 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639750    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0-socket-dir\") pod \"aws-ebs-csi-driver-node-bhj9m\" (UID: \"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.641311 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639790    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0-registration-dir\") pod \"aws-ebs-csi-driver-node-bhj9m\" (UID: \"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.641311 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639817    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-host-kubelet\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.641311 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:09.639819    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:09.641311 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:09.639892    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret podName:74532c4c-1206-4467-90af-b6dca8c3b5ac nodeName:}" failed. No retries permitted until 2026-09-11 17:45:10.139876055 +0000 UTC m=+3.065827793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret") pod "global-pull-secret-syncer-fzfxg" (UID: "74532c4c-1206-4467-90af-b6dca8c3b5ac") : object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:09.641311 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639909    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5a40983e-4ca5-4166-93c0-30f9432dbfbf-konnectivity-ca\") pod \"konnectivity-agent-tvgkk\" (UID: \"5a40983e-4ca5-4166-93c0-30f9432dbfbf\") " pod="kube-system/konnectivity-agent-tvgkk"
Sep 11 17:45:09.641311 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639917    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0-socket-dir\") pod \"aws-ebs-csi-driver-node-bhj9m\" (UID: \"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.641311 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639964    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bhj9m\" (UID: \"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.641311 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.639976    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-host-kubelet\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.641311 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.640016    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0-registration-dir\") pod \"aws-ebs-csi-driver-node-bhj9m\" (UID: \"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.641311 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.640028    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-run-ovn\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.641311 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.640195    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/48622241-45bc-48f3-97fc-3e4668889c15-iptables-alerter-script\") pod \"iptables-alerter-b459q\" (UID: \"48622241-45bc-48f3-97fc-3e4668889c15\") " pod="openshift-network-operator/iptables-alerter-b459q"
Sep 11 17:45:09.644724 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.642325    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-ovn-node-metrics-cert\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.644724 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.642502    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5a40983e-4ca5-4166-93c0-30f9432dbfbf-agent-certs\") pod \"konnectivity-agent-tvgkk\" (UID: \"5a40983e-4ca5-4166-93c0-30f9432dbfbf\") " pod="kube-system/konnectivity-agent-tvgkk"
Sep 11 17:45:09.650851 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.650791    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq8x7\" (UniqueName: \"kubernetes.io/projected/73e0fe43-f7e6-4418-b6c2-2f26221c994d-kube-api-access-zq8x7\") pod \"node-ca-6pqzm\" (UID: \"73e0fe43-f7e6-4418-b6c2-2f26221c994d\") " pod="openshift-image-registry/node-ca-6pqzm"
Sep 11 17:45:09.651035 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.651015    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv7jp\" (UniqueName: \"kubernetes.io/projected/cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd-kube-api-access-vv7jp\") pod \"ovnkube-node-l7zx6\" (UID: \"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.651450 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.651426    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7m8w\" (UniqueName: \"kubernetes.io/projected/dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0-kube-api-access-q7m8w\") pod \"aws-ebs-csi-driver-node-bhj9m\" (UID: \"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.651556 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.651536    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw4l7\" (UniqueName: \"kubernetes.io/projected/48622241-45bc-48f3-97fc-3e4668889c15-kube-api-access-zw4l7\") pod \"iptables-alerter-b459q\" (UID: \"48622241-45bc-48f3-97fc-3e4668889c15\") " pod="openshift-network-operator/iptables-alerter-b459q"
Sep 11 17:45:09.731826 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.731618    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6h9cq"
Sep 11 17:45:09.740781 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.740746    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hg88l"
Sep 11 17:45:09.754407 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.754381    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-szj28"
Sep 11 17:45:09.760183 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.760152    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m8n8w"
Sep 11 17:45:09.766794 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.766773    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tvgkk"
Sep 11 17:45:09.775383 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.775363    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m"
Sep 11 17:45:09.783156 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.783139    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:09.790664 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.790647    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6pqzm"
Sep 11 17:45:09.796221 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:09.796203    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b459q"
Sep 11 17:45:10.043220 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:10.043152    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs\") pod \"network-metrics-daemon-27scn\" (UID: \"ebc8fd61-b671-4d9e-9e23-756caf55b43c\") " pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:10.043220 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:10.043189    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jgz9\" (UniqueName: \"kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9\") pod \"network-check-target-hjngm\" (UID: \"ca5eeb84-ac64-4191-8943-67fb065f9d90\") " pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:10.043415 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:10.043321    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:10.043415 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:10.043374    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 17:45:10.043415 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:10.043390    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs podName:ebc8fd61-b671-4d9e-9e23-756caf55b43c nodeName:}" failed. No retries permitted until 2026-09-11 17:45:11.043368492 +0000 UTC m=+3.969320220 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs") pod "network-metrics-daemon-27scn" (UID: "ebc8fd61-b671-4d9e-9e23-756caf55b43c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:10.043415 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:10.043390    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 17:45:10.043415 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:10.043410    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8jgz9 for pod openshift-network-diagnostics/network-check-target-hjngm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:10.043609 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:10.043438    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9 podName:ca5eeb84-ac64-4191-8943-67fb065f9d90 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:11.043429588 +0000 UTC m=+3.969381312 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8jgz9" (UniqueName: "kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9") pod "network-check-target-hjngm" (UID: "ca5eeb84-ac64-4191-8943-67fb065f9d90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:10.143864 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:10.143820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret\") pod \"global-pull-secret-syncer-fzfxg\" (UID: \"74532c4c-1206-4467-90af-b6dca8c3b5ac\") " pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:10.144030 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:10.143965    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:10.144088 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:10.144035    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret podName:74532c4c-1206-4467-90af-b6dca8c3b5ac nodeName:}" failed. No retries permitted until 2026-09-11 17:45:11.144016506 +0000 UTC m=+4.069968249 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret") pod "global-pull-secret-syncer-fzfxg" (UID: "74532c4c-1206-4467-90af-b6dca8c3b5ac") : object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:10.496309 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:10.496223    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 17:40:09 +0000 UTC" deadline="2028-06-08 20:43:49.596503962 +0000 UTC"
Sep 11 17:45:10.496309 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:10.496264    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15266h58m39.100244518s"
Sep 11 17:45:10.706986 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:10.706961    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48622241_45bc_48f3_97fc_3e4668889c15.slice/crio-e42a200d04725bfff11db6674189dd31f50ed3ea0d30b00b3910e3882e3e2b19 WatchSource:0}: Error finding container e42a200d04725bfff11db6674189dd31f50ed3ea0d30b00b3910e3882e3e2b19: Status 404 returned error can't find the container with id e42a200d04725bfff11db6674189dd31f50ed3ea0d30b00b3910e3882e3e2b19
Sep 11 17:45:10.708576 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:10.708091    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc48582c7_77a6_40c2_b187_de7038c31e1f.slice/crio-a44b39607c236d18e5ee661216a190eff94e8f5991340a34d5f2c9414bcc1ae4 WatchSource:0}: Error finding container a44b39607c236d18e5ee661216a190eff94e8f5991340a34d5f2c9414bcc1ae4: Status 404 returned error can't find the container with id a44b39607c236d18e5ee661216a190eff94e8f5991340a34d5f2c9414bcc1ae4
Sep 11 17:45:10.712971 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:10.712949    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc2786c3_ff15_4108_b6df_ef1852972821.slice/crio-7eb2cb7e8ef521c15660c7cca573d9fb3afebcdfdb70de0f68238c16c8fa734f WatchSource:0}: Error finding container 7eb2cb7e8ef521c15660c7cca573d9fb3afebcdfdb70de0f68238c16c8fa734f: Status 404 returned error can't find the container with id 7eb2cb7e8ef521c15660c7cca573d9fb3afebcdfdb70de0f68238c16c8fa734f
Sep 11 17:45:10.713767 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:10.713732    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73e0fe43_f7e6_4418_b6c2_2f26221c994d.slice/crio-278a0599faf967c31de443390ff7c485a981c1050258b7853ec14eddd1dc3a55 WatchSource:0}: Error finding container 278a0599faf967c31de443390ff7c485a981c1050258b7853ec14eddd1dc3a55: Status 404 returned error can't find the container with id 278a0599faf967c31de443390ff7c485a981c1050258b7853ec14eddd1dc3a55
Sep 11 17:45:10.716165 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:10.716117    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod042f7b83_4c39_4ad8_a46b_17acc4753970.slice/crio-6aa0366844548b0299df9de7f2965b38c08d227539a49e9bb6dc5ff9e45e5bf0 WatchSource:0}: Error finding container 6aa0366844548b0299df9de7f2965b38c08d227539a49e9bb6dc5ff9e45e5bf0: Status 404 returned error can't find the container with id 6aa0366844548b0299df9de7f2965b38c08d227539a49e9bb6dc5ff9e45e5bf0
Sep 11 17:45:10.717257 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:10.717225    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cbcf37c_4462_4774_b2b9_cae117204cda.slice/crio-f9400e1b84e690f2c1909c18275cd65efebc1379d4b0a968bca30cf90d0758c2 WatchSource:0}: Error finding container f9400e1b84e690f2c1909c18275cd65efebc1379d4b0a968bca30cf90d0758c2: Status 404 returned error can't find the container with id f9400e1b84e690f2c1909c18275cd65efebc1379d4b0a968bca30cf90d0758c2
Sep 11 17:45:10.717889 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:10.717788    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a40983e_4ca5_4166_93c0_30f9432dbfbf.slice/crio-7612e2626da1ef77064c6b3d733ed85b2ca83ae193ac51f39a6f8ed93f96cdab WatchSource:0}: Error finding container 7612e2626da1ef77064c6b3d733ed85b2ca83ae193ac51f39a6f8ed93f96cdab: Status 404 returned error can't find the container with id 7612e2626da1ef77064c6b3d733ed85b2ca83ae193ac51f39a6f8ed93f96cdab
Sep 11 17:45:10.719055 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:10.719009    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdd7b59a_6f4b_46fb_a38e_92baa4ffc9cd.slice/crio-85eee9f45e86126f2e5d9059fe0774441ad565386eb3ea334641a38ec23f1133 WatchSource:0}: Error finding container 85eee9f45e86126f2e5d9059fe0774441ad565386eb3ea334641a38ec23f1133: Status 404 returned error can't find the container with id 85eee9f45e86126f2e5d9059fe0774441ad565386eb3ea334641a38ec23f1133
Sep 11 17:45:10.721143 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:10.720649    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd0f1d7f_1b63_42c2_b2ac_6f647fdc66f0.slice/crio-3953414fcab8984cd8db48aa2f0e90035363d4c04aa7e35017d03c56dc0edd73 WatchSource:0}: Error finding container 3953414fcab8984cd8db48aa2f0e90035363d4c04aa7e35017d03c56dc0edd73: Status 404 returned error can't find the container with id 3953414fcab8984cd8db48aa2f0e90035363d4c04aa7e35017d03c56dc0edd73
Sep 11 17:45:10.956819 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:10.956797    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 17:45:11.052313 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:11.052236    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs\") pod \"network-metrics-daemon-27scn\" (UID: \"ebc8fd61-b671-4d9e-9e23-756caf55b43c\") " pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:11.052313 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:11.052276    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jgz9\" (UniqueName: \"kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9\") pod \"network-check-target-hjngm\" (UID: \"ca5eeb84-ac64-4191-8943-67fb065f9d90\") " pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:11.052484 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:11.052338    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:11.052484 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:11.052401    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs podName:ebc8fd61-b671-4d9e-9e23-756caf55b43c nodeName:}" failed. No retries permitted until 2026-09-11 17:45:13.052385177 +0000 UTC m=+5.978336906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs") pod "network-metrics-daemon-27scn" (UID: "ebc8fd61-b671-4d9e-9e23-756caf55b43c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:11.052484 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:11.052410    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 17:45:11.052484 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:11.052423    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 17:45:11.052484 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:11.052432    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8jgz9 for pod openshift-network-diagnostics/network-check-target-hjngm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:11.052484 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:11.052470    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9 podName:ca5eeb84-ac64-4191-8943-67fb065f9d90 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:13.052459591 +0000 UTC m=+5.978411331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8jgz9" (UniqueName: "kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9") pod "network-check-target-hjngm" (UID: "ca5eeb84-ac64-4191-8943-67fb065f9d90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:11.153476 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:11.153442    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret\") pod \"global-pull-secret-syncer-fzfxg\" (UID: \"74532c4c-1206-4467-90af-b6dca8c3b5ac\") " pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:11.153660 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:11.153572    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:11.153660 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:11.153634    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret podName:74532c4c-1206-4467-90af-b6dca8c3b5ac nodeName:}" failed. No retries permitted until 2026-09-11 17:45:13.153617052 +0000 UTC m=+6.079568779 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret") pod "global-pull-secret-syncer-fzfxg" (UID: "74532c4c-1206-4467-90af-b6dca8c3b5ac") : object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:11.496982 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:11.496892    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 17:40:09 +0000 UTC" deadline="2028-03-17 05:14:42.732780846 +0000 UTC"
Sep 11 17:45:11.496982 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:11.496933    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13259h29m31.235852972s"
Sep 11 17:45:11.535646 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:11.530598    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:11.535646 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:11.530717    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjngm" podUID="ca5eeb84-ac64-4191-8943-67fb065f9d90"
Sep 11 17:45:11.535646 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:11.530871    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:11.535646 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:11.530954    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzfxg" podUID="74532c4c-1206-4467-90af-b6dca8c3b5ac"
Sep 11 17:45:11.535646 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:11.531051    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:11.535646 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:11.531136    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27scn" podUID="ebc8fd61-b671-4d9e-9e23-756caf55b43c"
Sep 11 17:45:11.543813 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:11.543781    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tvgkk" event={"ID":"5a40983e-4ca5-4166-93c0-30f9432dbfbf","Type":"ContainerStarted","Data":"7612e2626da1ef77064c6b3d733ed85b2ca83ae193ac51f39a6f8ed93f96cdab"}
Sep 11 17:45:11.550449 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:11.550412    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6" event={"ID":"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd","Type":"ContainerStarted","Data":"85eee9f45e86126f2e5d9059fe0774441ad565386eb3ea334641a38ec23f1133"}
Sep 11 17:45:11.559969 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:11.559942    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-szj28" event={"ID":"042f7b83-4c39-4ad8-a46b-17acc4753970","Type":"ContainerStarted","Data":"6aa0366844548b0299df9de7f2965b38c08d227539a49e9bb6dc5ff9e45e5bf0"}
Sep 11 17:45:11.569147 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:11.569092    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6pqzm" event={"ID":"73e0fe43-f7e6-4418-b6c2-2f26221c994d","Type":"ContainerStarted","Data":"278a0599faf967c31de443390ff7c485a981c1050258b7853ec14eddd1dc3a55"}
Sep 11 17:45:11.571434 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:11.571387    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m8n8w" event={"ID":"bc2786c3-ff15-4108-b6df-ef1852972821","Type":"ContainerStarted","Data":"7eb2cb7e8ef521c15660c7cca573d9fb3afebcdfdb70de0f68238c16c8fa734f"}
Sep 11 17:45:11.575541 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:11.575519    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg88l" event={"ID":"c48582c7-77a6-40c2-b187-de7038c31e1f","Type":"ContainerStarted","Data":"a44b39607c236d18e5ee661216a190eff94e8f5991340a34d5f2c9414bcc1ae4"}
Sep 11 17:45:11.585006 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:11.584960    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b459q" event={"ID":"48622241-45bc-48f3-97fc-3e4668889c15","Type":"ContainerStarted","Data":"e42a200d04725bfff11db6674189dd31f50ed3ea0d30b00b3910e3882e3e2b19"}
Sep 11 17:45:11.598832 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:11.598571    2579 generic.go:356] "Generic (PLEG): container finished" podID="68fca22effbed069bcacb26330a72d8f" containerID="3802d4358f42885cfa60736ce961ae3c9a9a51a3fa78a6faceec03e1f93c52b6" exitCode=0
Sep 11 17:45:11.598832 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:11.598643    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-211.ec2.internal" event={"ID":"68fca22effbed069bcacb26330a72d8f","Type":"ContainerDied","Data":"3802d4358f42885cfa60736ce961ae3c9a9a51a3fa78a6faceec03e1f93c52b6"}
Sep 11 17:45:11.614107 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:11.612220    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-211.ec2.internal" event={"ID":"42033061b2efc1a5de4a9db1dfbac058","Type":"ContainerStarted","Data":"9058a779c5a173ee4235435572be1b7c2fb9dd1a075dd9acd887c8b705f2bd5d"}
Sep 11 17:45:11.619537 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:11.619195    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m" event={"ID":"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0","Type":"ContainerStarted","Data":"3953414fcab8984cd8db48aa2f0e90035363d4c04aa7e35017d03c56dc0edd73"}
Sep 11 17:45:11.633690 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:11.633635    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6h9cq" event={"ID":"2cbcf37c-4462-4774-b2b9-cae117204cda","Type":"ContainerStarted","Data":"f9400e1b84e690f2c1909c18275cd65efebc1379d4b0a968bca30cf90d0758c2"}
Sep 11 17:45:11.649588 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:11.649541    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-211.ec2.internal" podStartSLOduration=3.64952482 podStartE2EDuration="3.64952482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:45:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:11.649124301 +0000 UTC m=+4.575076048" watchObservedRunningTime="2026-09-11 17:45:11.64952482 +0000 UTC m=+4.575476570"
Sep 11 17:45:12.655729 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:12.655693    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-211.ec2.internal" event={"ID":"68fca22effbed069bcacb26330a72d8f","Type":"ContainerStarted","Data":"dd6e303b419464d5e31b4537ac3086e97812b3e17560afcc214952425e2568e8"}
Sep 11 17:45:12.687297 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:12.687240    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-211.ec2.internal" podStartSLOduration=4.687217269 podStartE2EDuration="4.687217269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:45:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:12.686948761 +0000 UTC m=+5.612900513" watchObservedRunningTime="2026-09-11 17:45:12.687217269 +0000 UTC m=+5.613169016"
Sep 11 17:45:13.074269 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:13.074236    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs\") pod \"network-metrics-daemon-27scn\" (UID: \"ebc8fd61-b671-4d9e-9e23-756caf55b43c\") " pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:13.074437 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:13.074286    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jgz9\" (UniqueName: \"kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9\") pod \"network-check-target-hjngm\" (UID: \"ca5eeb84-ac64-4191-8943-67fb065f9d90\") " pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:13.074514 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:13.074480    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 17:45:13.074514 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:13.074501    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 17:45:13.074514 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:13.074514    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8jgz9 for pod openshift-network-diagnostics/network-check-target-hjngm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:13.074657 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:13.074569    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9 podName:ca5eeb84-ac64-4191-8943-67fb065f9d90 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:17.07455238 +0000 UTC m=+10.000504112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8jgz9" (UniqueName: "kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9") pod "network-check-target-hjngm" (UID: "ca5eeb84-ac64-4191-8943-67fb065f9d90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:13.074997 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:13.074977    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:13.075086 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:13.075035    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs podName:ebc8fd61-b671-4d9e-9e23-756caf55b43c nodeName:}" failed. No retries permitted until 2026-09-11 17:45:17.075018954 +0000 UTC m=+10.000970693 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs") pod "network-metrics-daemon-27scn" (UID: "ebc8fd61-b671-4d9e-9e23-756caf55b43c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:13.175043 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:13.175010    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret\") pod \"global-pull-secret-syncer-fzfxg\" (UID: \"74532c4c-1206-4467-90af-b6dca8c3b5ac\") " pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:13.175214 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:13.175175    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:13.175277 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:13.175229    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret podName:74532c4c-1206-4467-90af-b6dca8c3b5ac nodeName:}" failed. No retries permitted until 2026-09-11 17:45:17.175212423 +0000 UTC m=+10.101164146 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret") pod "global-pull-secret-syncer-fzfxg" (UID: "74532c4c-1206-4467-90af-b6dca8c3b5ac") : object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:13.529939 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:13.529860    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:13.530088 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:13.529981    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjngm" podUID="ca5eeb84-ac64-4191-8943-67fb065f9d90"
Sep 11 17:45:13.530385 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:13.530360    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:13.530482 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:13.530469    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27scn" podUID="ebc8fd61-b671-4d9e-9e23-756caf55b43c"
Sep 11 17:45:13.530643 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:13.530588    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:13.530704 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:13.530672    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzfxg" podUID="74532c4c-1206-4467-90af-b6dca8c3b5ac"
Sep 11 17:45:15.528553 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:15.528037    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:15.528553 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:15.528037    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:15.528553 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:15.528192    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27scn" podUID="ebc8fd61-b671-4d9e-9e23-756caf55b43c"
Sep 11 17:45:15.528553 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:15.528249    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:15.528553 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:15.528378    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzfxg" podUID="74532c4c-1206-4467-90af-b6dca8c3b5ac"
Sep 11 17:45:15.528553 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:15.528465    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjngm" podUID="ca5eeb84-ac64-4191-8943-67fb065f9d90"
Sep 11 17:45:17.109403 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:17.109366    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs\") pod \"network-metrics-daemon-27scn\" (UID: \"ebc8fd61-b671-4d9e-9e23-756caf55b43c\") " pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:17.109898 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:17.109421    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jgz9\" (UniqueName: \"kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9\") pod \"network-check-target-hjngm\" (UID: \"ca5eeb84-ac64-4191-8943-67fb065f9d90\") " pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:17.109898 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:17.109548    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:17.109898 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:17.109609    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 17:45:17.109898 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:17.109625    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs podName:ebc8fd61-b671-4d9e-9e23-756caf55b43c nodeName:}" failed. No retries permitted until 2026-09-11 17:45:25.109604786 +0000 UTC m=+18.035556522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs") pod "network-metrics-daemon-27scn" (UID: "ebc8fd61-b671-4d9e-9e23-756caf55b43c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:17.109898 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:17.109626    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 17:45:17.109898 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:17.109647    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8jgz9 for pod openshift-network-diagnostics/network-check-target-hjngm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:17.109898 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:17.109681    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9 podName:ca5eeb84-ac64-4191-8943-67fb065f9d90 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:25.109670869 +0000 UTC m=+18.035622600 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8jgz9" (UniqueName: "kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9") pod "network-check-target-hjngm" (UID: "ca5eeb84-ac64-4191-8943-67fb065f9d90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:17.210828 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:17.210795    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret\") pod \"global-pull-secret-syncer-fzfxg\" (UID: \"74532c4c-1206-4467-90af-b6dca8c3b5ac\") " pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:17.210988 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:17.210956    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:17.211070 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:17.211047    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret podName:74532c4c-1206-4467-90af-b6dca8c3b5ac nodeName:}" failed. No retries permitted until 2026-09-11 17:45:25.211025918 +0000 UTC m=+18.136977655 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret") pod "global-pull-secret-syncer-fzfxg" (UID: "74532c4c-1206-4467-90af-b6dca8c3b5ac") : object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:17.528522 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:17.528445    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:17.528670 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:17.528552    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjngm" podUID="ca5eeb84-ac64-4191-8943-67fb065f9d90"
Sep 11 17:45:17.528726 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:17.528692    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:17.528982 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:17.528824    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:17.528982 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:17.528870    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzfxg" podUID="74532c4c-1206-4467-90af-b6dca8c3b5ac"
Sep 11 17:45:17.528982 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:17.528926    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27scn" podUID="ebc8fd61-b671-4d9e-9e23-756caf55b43c"
Sep 11 17:45:19.528176 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:19.527694    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:19.528176 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:19.527710    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:19.528176 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:19.527700    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:19.528176 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:19.527842    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjngm" podUID="ca5eeb84-ac64-4191-8943-67fb065f9d90"
Sep 11 17:45:19.528176 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:19.527949    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27scn" podUID="ebc8fd61-b671-4d9e-9e23-756caf55b43c"
Sep 11 17:45:19.528176 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:19.528042    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzfxg" podUID="74532c4c-1206-4467-90af-b6dca8c3b5ac"
Sep 11 17:45:21.528074 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:21.528034    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:21.528509 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:21.528034    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:21.528509 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:21.528166    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27scn" podUID="ebc8fd61-b671-4d9e-9e23-756caf55b43c"
Sep 11 17:45:21.528509 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:21.528189    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:21.528509 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:21.528285    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzfxg" podUID="74532c4c-1206-4467-90af-b6dca8c3b5ac"
Sep 11 17:45:21.528509 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:21.528364    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjngm" podUID="ca5eeb84-ac64-4191-8943-67fb065f9d90"
Sep 11 17:45:23.528568 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:23.528535    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:23.529057 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:23.528573    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:23.529057 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:23.528542    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:23.529057 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:23.528662    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjngm" podUID="ca5eeb84-ac64-4191-8943-67fb065f9d90"
Sep 11 17:45:23.529057 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:23.528787    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27scn" podUID="ebc8fd61-b671-4d9e-9e23-756caf55b43c"
Sep 11 17:45:23.529057 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:23.528865    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzfxg" podUID="74532c4c-1206-4467-90af-b6dca8c3b5ac"
Sep 11 17:45:25.170234 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:25.170194    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs\") pod \"network-metrics-daemon-27scn\" (UID: \"ebc8fd61-b671-4d9e-9e23-756caf55b43c\") " pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:25.170234 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:25.170238    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jgz9\" (UniqueName: \"kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9\") pod \"network-check-target-hjngm\" (UID: \"ca5eeb84-ac64-4191-8943-67fb065f9d90\") " pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:25.170821 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:25.170364    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 17:45:25.170821 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:25.170365    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:25.170821 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:25.170376    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 17:45:25.170821 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:25.170440    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8jgz9 for pod openshift-network-diagnostics/network-check-target-hjngm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:25.170821 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:25.170441    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs podName:ebc8fd61-b671-4d9e-9e23-756caf55b43c nodeName:}" failed. No retries permitted until 2026-09-11 17:45:41.170420852 +0000 UTC m=+34.096372578 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs") pod "network-metrics-daemon-27scn" (UID: "ebc8fd61-b671-4d9e-9e23-756caf55b43c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:25.170821 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:25.170527    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9 podName:ca5eeb84-ac64-4191-8943-67fb065f9d90 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:41.170508576 +0000 UTC m=+34.096460316 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8jgz9" (UniqueName: "kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9") pod "network-check-target-hjngm" (UID: "ca5eeb84-ac64-4191-8943-67fb065f9d90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:25.271775 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:25.271728    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret\") pod \"global-pull-secret-syncer-fzfxg\" (UID: \"74532c4c-1206-4467-90af-b6dca8c3b5ac\") " pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:25.271958 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:25.271885    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:25.272030 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:25.271960    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret podName:74532c4c-1206-4467-90af-b6dca8c3b5ac nodeName:}" failed. No retries permitted until 2026-09-11 17:45:41.271942261 +0000 UTC m=+34.197893999 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret") pod "global-pull-secret-syncer-fzfxg" (UID: "74532c4c-1206-4467-90af-b6dca8c3b5ac") : object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:25.527931 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:25.527809    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:25.527931 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:25.527826    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:25.527931 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:25.527845    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:25.528188 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:25.527929    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27scn" podUID="ebc8fd61-b671-4d9e-9e23-756caf55b43c"
Sep 11 17:45:25.528188 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:25.527985    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjngm" podUID="ca5eeb84-ac64-4191-8943-67fb065f9d90"
Sep 11 17:45:25.528188 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:25.528114    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzfxg" podUID="74532c4c-1206-4467-90af-b6dca8c3b5ac"
Sep 11 17:45:27.530750 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:27.530719    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:27.531196 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:27.530755    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:27.531196 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:27.530755    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:27.531196 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:27.530847    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjngm" podUID="ca5eeb84-ac64-4191-8943-67fb065f9d90"
Sep 11 17:45:27.531196 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:27.530953    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzfxg" podUID="74532c4c-1206-4467-90af-b6dca8c3b5ac"
Sep 11 17:45:27.531196 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:27.531040    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27scn" podUID="ebc8fd61-b671-4d9e-9e23-756caf55b43c"
Sep 11 17:45:28.686147 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:28.686114    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m" event={"ID":"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0","Type":"ContainerStarted","Data":"1bae6fff5db91b2cd668d02d406e2260ecd892cb719b1fe9ae4c0dd119d7ab1c"}
Sep 11 17:45:28.687463 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:28.687439    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6h9cq" event={"ID":"2cbcf37c-4462-4774-b2b9-cae117204cda","Type":"ContainerStarted","Data":"295dca021cb25776c4c5f2015210a1ae0293b63ab1dc602573e73857ba6d0f56"}
Sep 11 17:45:28.688807 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:28.688783    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tvgkk" event={"ID":"5a40983e-4ca5-4166-93c0-30f9432dbfbf","Type":"ContainerStarted","Data":"2476a2278f6baa7abda5f5b42b7c320c20b59c7936749b19b6eeb0bf53e50ef1"}
Sep 11 17:45:28.690144 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:28.690116    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-szj28" event={"ID":"042f7b83-4c39-4ad8-a46b-17acc4753970","Type":"ContainerStarted","Data":"ca274b09250043e2f94b45f7c5845fc63e0b26622237eedf82aefbce7e625590"}
Sep 11 17:45:28.691506 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:28.691483    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6pqzm" event={"ID":"73e0fe43-f7e6-4418-b6c2-2f26221c994d","Type":"ContainerStarted","Data":"0f53c7f3dc23d11552cd1fb0aade21b81c8e07fb33d7e8b3428b2309409c735a"}
Sep 11 17:45:28.693040 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:28.693018    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m8n8w" event={"ID":"bc2786c3-ff15-4108-b6df-ef1852972821","Type":"ContainerStarted","Data":"7273ca998d5c5b30aba94d4015c002610b5b49def1aa23478daa0aba65133e25"}
Sep 11 17:45:28.694665 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:28.694646    2579 generic.go:356] "Generic (PLEG): container finished" podID="c48582c7-77a6-40c2-b187-de7038c31e1f" containerID="bd52420613a89eb2f4ba007b5cdad1dd0570282ef014b219d5b3ee7f4713a116" exitCode=0
Sep 11 17:45:28.694782 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:28.694678    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg88l" event={"ID":"c48582c7-77a6-40c2-b187-de7038c31e1f","Type":"ContainerDied","Data":"bd52420613a89eb2f4ba007b5cdad1dd0570282ef014b219d5b3ee7f4713a116"}
Sep 11 17:45:28.754180 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:28.754134    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6pqzm" podStartSLOduration=4.450822281 podStartE2EDuration="21.754118629s" totalImagesPullingTime="17.303296348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:28.753897462 +0000 UTC m=+21.679849219" watchObservedRunningTime="2026-09-11 17:45:28.754118629 +0000 UTC m=+21.680070371"
Sep 11 17:45:28.754309 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:28.754264    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6h9cq" podStartSLOduration=4.103844433 podStartE2EDuration="21.754255331s" totalImagesPullingTime="17.650410898s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:28.715580784 +0000 UTC m=+21.641532529" watchObservedRunningTime="2026-09-11 17:45:28.754255331 +0000 UTC m=+21.680207078"
Sep 11 17:45:28.872344 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:28.872144    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tvgkk" podStartSLOduration=4.5737981 podStartE2EDuration="21.872128291s" totalImagesPullingTime="17.298330191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:28.871642511 +0000 UTC m=+21.797594260" watchObservedRunningTime="2026-09-11 17:45:28.872128291 +0000 UTC m=+21.798080036"
Sep 11 17:45:28.900337 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:28.900289    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-szj28" podStartSLOduration=4.532243407 podStartE2EDuration="21.900268864s" totalImagesPullingTime="17.368025457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:28.899838876 +0000 UTC m=+21.825790623" watchObservedRunningTime="2026-09-11 17:45:28.900268864 +0000 UTC m=+21.826220615"
Sep 11 17:45:29.121274 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:29.121253    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tvgkk"
Sep 11 17:45:29.532188 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:29.532165    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:29.532297 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:29.532165    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:29.532297 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:29.532275    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:29.532297 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:29.532283    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzfxg" podUID="74532c4c-1206-4467-90af-b6dca8c3b5ac"
Sep 11 17:45:29.532419 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:29.532336    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27scn" podUID="ebc8fd61-b671-4d9e-9e23-756caf55b43c"
Sep 11 17:45:29.532469 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:29.532435    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjngm" podUID="ca5eeb84-ac64-4191-8943-67fb065f9d90"
Sep 11 17:45:29.700319 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:29.700157    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zx6_cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd/ovn-acl-logging/0.log"
Sep 11 17:45:29.701104 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:29.700578    2579 generic.go:356] "Generic (PLEG): container finished" podID="cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd" containerID="4aa919c44373fc5a13eec764d4ea945f1a3f4f7f7c2179138746f4c86602bca4" exitCode=1
Sep 11 17:45:29.701104 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:29.700662    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6" event={"ID":"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd","Type":"ContainerStarted","Data":"7260df4ed8c9d4f358f3c390de68c5aa23289651ae0f70a7046f54790e74d135"}
Sep 11 17:45:29.701104 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:29.700737    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6" event={"ID":"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd","Type":"ContainerStarted","Data":"2f5f63d74f578488d3090db3427bdce15d481823adcec930c65ba4f19cd346ab"}
Sep 11 17:45:29.701104 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:29.700808    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6" event={"ID":"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd","Type":"ContainerStarted","Data":"dcb27a648093f34d695c3ce87231ed0d80802a2bc932542f4158d1b6c4c8a72d"}
Sep 11 17:45:29.701104 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:29.700855    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6" event={"ID":"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd","Type":"ContainerStarted","Data":"8827b03f1d234e9578c22740e11f879cf75bbc85d4cf38b0fa614492abba5b95"}
Sep 11 17:45:29.701104 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:29.700893    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6" event={"ID":"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd","Type":"ContainerDied","Data":"4aa919c44373fc5a13eec764d4ea945f1a3f4f7f7c2179138746f4c86602bca4"}
Sep 11 17:45:29.701104 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:29.700929    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6" event={"ID":"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd","Type":"ContainerStarted","Data":"4ffcd1cc9721cc79fdb5f0d815064dc5ee15a2f4449389df4dc8e3cce0bb02b4"}
Sep 11 17:45:29.702605 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:29.702578    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b459q" event={"ID":"48622241-45bc-48f3-97fc-3e4668889c15","Type":"ContainerStarted","Data":"866a2aa9e272575e100d8d5cae8fe62e9862816a3b6b780b76b9e68f642dbbf8"}
Sep 11 17:45:29.738647 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:29.738606    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-m8n8w" podStartSLOduration=5.364094396 podStartE2EDuration="22.738590891s" totalImagesPullingTime="17.374496495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:28.955851177 +0000 UTC m=+21.881802923" watchObservedRunningTime="2026-09-11 17:45:29.738590891 +0000 UTC m=+22.664542637"
Sep 11 17:45:29.738835 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:29.738814    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b459q" podStartSLOduration=5.363863944 podStartE2EDuration="22.738807778s" totalImagesPullingTime="17.374943834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:29.73855967 +0000 UTC m=+22.664511616" watchObservedRunningTime="2026-09-11 17:45:29.738807778 +0000 UTC m=+22.664759523"
Sep 11 17:45:29.898299 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:29.898258    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 17:45:30.493136 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:30.493046    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T17:45:29.89828015Z","UUID":"d39a6c79-5fdf-493b-ab14-ce87b5f95d0c","Handler":null,"Name":"","Endpoint":""}
Sep 11 17:45:30.495995 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:30.495973    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 17:45:30.495995 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:30.496006    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 17:45:30.707462 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:30.707428    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m" event={"ID":"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0","Type":"ContainerStarted","Data":"b6a343161185d218a9976c0adb617a3860851c8719c36633875eca736032f5fb"}
Sep 11 17:45:31.528515 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:31.528479    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:31.528798 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:31.528490    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:31.528798 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:31.528605    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:31.528798 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:31.528609    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjngm" podUID="ca5eeb84-ac64-4191-8943-67fb065f9d90"
Sep 11 17:45:31.528798 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:31.528702    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27scn" podUID="ebc8fd61-b671-4d9e-9e23-756caf55b43c"
Sep 11 17:45:31.529020 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:31.528801    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzfxg" podUID="74532c4c-1206-4467-90af-b6dca8c3b5ac"
Sep 11 17:45:32.611084 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:32.611049    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tvgkk"
Sep 11 17:45:32.611729 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:32.611708    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tvgkk"
Sep 11 17:45:32.713014 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:32.712982    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tvgkk"
Sep 11 17:45:33.528330 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:33.528095    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:33.528482 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:33.528095    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:33.528482 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:33.528359    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27scn" podUID="ebc8fd61-b671-4d9e-9e23-756caf55b43c"
Sep 11 17:45:33.528482 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:33.528095    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:33.528482 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:33.528427    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzfxg" podUID="74532c4c-1206-4467-90af-b6dca8c3b5ac"
Sep 11 17:45:33.528629 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:33.528502    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjngm" podUID="ca5eeb84-ac64-4191-8943-67fb065f9d90"
Sep 11 17:45:33.716117 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:33.716083    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m" event={"ID":"dd0f1d7f-1b63-42c2-b2ac-6f647fdc66f0","Type":"ContainerStarted","Data":"31f7d9777e1f8f61ccf8467ffaf46a95bf805c9019095bed5d011b999ddfadb7"}
Sep 11 17:45:33.719017 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:33.718996    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zx6_cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd/ovn-acl-logging/0.log"
Sep 11 17:45:33.719370 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:33.719352    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6" event={"ID":"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd","Type":"ContainerStarted","Data":"f1c8391cd75996ae119bda96df920a5a421702714ccc2d4fea2261e1549be1d8"}
Sep 11 17:45:33.720973 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:33.720952    2579 generic.go:356] "Generic (PLEG): container finished" podID="c48582c7-77a6-40c2-b187-de7038c31e1f" containerID="8e6d856cf9250f994eb69701042f617f6f245b934a791ac9af7668569d138100" exitCode=0
Sep 11 17:45:33.721086 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:33.721039    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg88l" event={"ID":"c48582c7-77a6-40c2-b187-de7038c31e1f","Type":"ContainerDied","Data":"8e6d856cf9250f994eb69701042f617f6f245b934a791ac9af7668569d138100"}
Sep 11 17:45:33.795714 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:33.795621    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhj9m" podStartSLOduration=4.839657579 podStartE2EDuration="26.795604517s" totalImagesPullingTime="21.955946938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:45:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:33.748127994 +0000 UTC m=+26.674079740" watchObservedRunningTime="2026-09-11 17:45:33.795604517 +0000 UTC m=+26.721556287"
Sep 11 17:45:35.527949 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:35.527913    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:35.528902 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:35.527919    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:35.528902 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:35.528046    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzfxg" podUID="74532c4c-1206-4467-90af-b6dca8c3b5ac"
Sep 11 17:45:35.528902 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:35.527919    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:35.528902 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:35.528106    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27scn" podUID="ebc8fd61-b671-4d9e-9e23-756caf55b43c"
Sep 11 17:45:35.528902 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:35.528156    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjngm" podUID="ca5eeb84-ac64-4191-8943-67fb065f9d90"
Sep 11 17:45:35.728912 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:35.728845    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zx6_cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd/ovn-acl-logging/0.log"
Sep 11 17:45:35.729247 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:35.729224    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6" event={"ID":"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd","Type":"ContainerStarted","Data":"4b1d720c800292a701711a558637967c5147e51a9faac4bf7310d263d3ca574e"}
Sep 11 17:45:35.729490 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:35.729474    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:35.729710 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:35.729692    2579 scope.go:117] "RemoveContainer" containerID="4aa919c44373fc5a13eec764d4ea945f1a3f4f7f7c2179138746f4c86602bca4"
Sep 11 17:45:35.731652 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:35.731630    2579 generic.go:356] "Generic (PLEG): container finished" podID="c48582c7-77a6-40c2-b187-de7038c31e1f" containerID="953474fbb19145b1d0421e5509912c994dce2f9131f8729a18fb1dda9ea871ea" exitCode=0
Sep 11 17:45:35.731750 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:35.731678    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg88l" event={"ID":"c48582c7-77a6-40c2-b187-de7038c31e1f","Type":"ContainerDied","Data":"953474fbb19145b1d0421e5509912c994dce2f9131f8729a18fb1dda9ea871ea"}
Sep 11 17:45:35.746141 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:35.746119    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:36.736851 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:36.736620    2579 generic.go:356] "Generic (PLEG): container finished" podID="c48582c7-77a6-40c2-b187-de7038c31e1f" containerID="c7ea03de570d0d9c1cc6a1481d400d34d496872460190f9086d2a1fff2418caa" exitCode=0
Sep 11 17:45:36.737285 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:36.736681    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg88l" event={"ID":"c48582c7-77a6-40c2-b187-de7038c31e1f","Type":"ContainerDied","Data":"c7ea03de570d0d9c1cc6a1481d400d34d496872460190f9086d2a1fff2418caa"}
Sep 11 17:45:36.741224 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:36.741201    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zx6_cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd/ovn-acl-logging/0.log"
Sep 11 17:45:36.741608 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:36.741586    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6" event={"ID":"cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd","Type":"ContainerStarted","Data":"6a8030c53b520db7df98071c50eb082a2a3ea78c1482d2587451e55cc4a11d41"}
Sep 11 17:45:36.741801 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:36.741785    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:36.741881 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:36.741843    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:36.756647 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:36.756622    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:45:36.790277 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:36.790181    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6" podStartSLOduration=11.787376496 podStartE2EDuration="29.790158198s" totalImagesPullingTime="18.002781702s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:36.789958135 +0000 UTC m=+29.715909882" watchObservedRunningTime="2026-09-11 17:45:36.790158198 +0000 UTC m=+29.716109958"
Sep 11 17:45:37.277963 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:37.277306    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hjngm"]
Sep 11 17:45:37.277963 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:37.277455    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:37.277963 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:37.277563    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjngm" podUID="ca5eeb84-ac64-4191-8943-67fb065f9d90"
Sep 11 17:45:37.278256 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:37.278158    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fzfxg"]
Sep 11 17:45:37.278312 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:37.278259    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:37.279273 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:37.278352    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzfxg" podUID="74532c4c-1206-4467-90af-b6dca8c3b5ac"
Sep 11 17:45:37.279273 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:37.279245    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-27scn"]
Sep 11 17:45:37.279413 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:37.279353    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:37.279462 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:37.279450    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27scn" podUID="ebc8fd61-b671-4d9e-9e23-756caf55b43c"
Sep 11 17:45:39.527997 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:39.527960    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:39.528544 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:39.527960    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:39.528544 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:39.528090    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjngm" podUID="ca5eeb84-ac64-4191-8943-67fb065f9d90"
Sep 11 17:45:39.528544 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:39.528122    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:39.528544 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:39.528192    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27scn" podUID="ebc8fd61-b671-4d9e-9e23-756caf55b43c"
Sep 11 17:45:39.528779 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:39.528580    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzfxg" podUID="74532c4c-1206-4467-90af-b6dca8c3b5ac"
Sep 11 17:45:41.189398 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.189165    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs\") pod \"network-metrics-daemon-27scn\" (UID: \"ebc8fd61-b671-4d9e-9e23-756caf55b43c\") " pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:41.189398 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:41.189302    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:41.189398 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.189361    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jgz9\" (UniqueName: \"kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9\") pod \"network-check-target-hjngm\" (UID: \"ca5eeb84-ac64-4191-8943-67fb065f9d90\") " pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:41.189837 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:41.189419    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs podName:ebc8fd61-b671-4d9e-9e23-756caf55b43c nodeName:}" failed. No retries permitted until 2026-09-11 17:46:13.1894018 +0000 UTC m=+66.115353528 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs") pod "network-metrics-daemon-27scn" (UID: "ebc8fd61-b671-4d9e-9e23-756caf55b43c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:41.189837 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:41.189465    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 17:45:41.189837 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:41.189477    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 17:45:41.189837 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:41.189486    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8jgz9 for pod openshift-network-diagnostics/network-check-target-hjngm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:41.189837 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:41.189531    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9 podName:ca5eeb84-ac64-4191-8943-67fb065f9d90 nodeName:}" failed. No retries permitted until 2026-09-11 17:46:13.189518922 +0000 UTC m=+66.115470666 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8jgz9" (UniqueName: "kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9") pod "network-check-target-hjngm" (UID: "ca5eeb84-ac64-4191-8943-67fb065f9d90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:41.290111 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.290081    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret\") pod \"global-pull-secret-syncer-fzfxg\" (UID: \"74532c4c-1206-4467-90af-b6dca8c3b5ac\") " pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:41.292727 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:41.290586    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:41.292727 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:41.290708    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret podName:74532c4c-1206-4467-90af-b6dca8c3b5ac nodeName:}" failed. No retries permitted until 2026-09-11 17:46:13.290654594 +0000 UTC m=+66.216606332 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret") pod "global-pull-secret-syncer-fzfxg" (UID: "74532c4c-1206-4467-90af-b6dca8c3b5ac") : object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:41.528134 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.528041    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:41.528293 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.528041    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:41.528293 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:41.528194    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27scn" podUID="ebc8fd61-b671-4d9e-9e23-756caf55b43c"
Sep 11 17:45:41.528293 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.528041    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:41.528293 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:41.528231    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjngm" podUID="ca5eeb84-ac64-4191-8943-67fb065f9d90"
Sep 11 17:45:41.528485 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:41.528310    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzfxg" podUID="74532c4c-1206-4467-90af-b6dca8c3b5ac"
Sep 11 17:45:41.757438 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.757406    2579 generic.go:356] "Generic (PLEG): container finished" podID="c48582c7-77a6-40c2-b187-de7038c31e1f" containerID="343f2cd3712bb81899d40849354cf81a361df0ed646cd1f40539678c46ede5b7" exitCode=0
Sep 11 17:45:41.757623 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.757454    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg88l" event={"ID":"c48582c7-77a6-40c2-b187-de7038c31e1f","Type":"ContainerDied","Data":"343f2cd3712bb81899d40849354cf81a361df0ed646cd1f40539678c46ede5b7"}
Sep 11 17:45:41.889563 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.889540    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-211.ec2.internal" event="NodeReady"
Sep 11 17:45:41.889680 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.889668    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 17:45:41.936917 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.936860    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xnrgn"]
Sep 11 17:45:41.942735 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.942715    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r6npp"]
Sep 11 17:45:41.942856 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.942842    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:45:41.945156 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.945135    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 17:45:41.945263 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.945137    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tc7ww\""
Sep 11 17:45:41.945263 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.945137    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 17:45:41.948812 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.948795    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r6npp"
Sep 11 17:45:41.950747 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.950732    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 17:45:41.950747 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.950739    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 17:45:41.950747 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.950747    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5xw8q\""
Sep 11 17:45:41.951100 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.951088    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 17:45:41.953180 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.953162    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r6npp"]
Sep 11 17:45:41.955286 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:41.955264    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xnrgn"]
Sep 11 17:45:42.095007 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.094931    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7da14b29-4d93-4577-b16c-db6d30d0255e-cert\") pod \"ingress-canary-r6npp\" (UID: \"7da14b29-4d93-4577-b16c-db6d30d0255e\") " pod="openshift-ingress-canary/ingress-canary-r6npp"
Sep 11 17:45:42.095007 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.094966    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51199ad2-1d9f-4951-af87-21d70591fdf7-config-volume\") pod \"dns-default-xnrgn\" (UID: \"51199ad2-1d9f-4951-af87-21d70591fdf7\") " pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:45:42.095205 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.095036    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9cw6\" (UniqueName: \"kubernetes.io/projected/7da14b29-4d93-4577-b16c-db6d30d0255e-kube-api-access-c9cw6\") pod \"ingress-canary-r6npp\" (UID: \"7da14b29-4d93-4577-b16c-db6d30d0255e\") " pod="openshift-ingress-canary/ingress-canary-r6npp"
Sep 11 17:45:42.095205 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.095064    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls\") pod \"dns-default-xnrgn\" (UID: \"51199ad2-1d9f-4951-af87-21d70591fdf7\") " pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:45:42.095205 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.095113    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51199ad2-1d9f-4951-af87-21d70591fdf7-tmp-dir\") pod \"dns-default-xnrgn\" (UID: \"51199ad2-1d9f-4951-af87-21d70591fdf7\") " pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:45:42.095205 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.095130    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67gfc\" (UniqueName: \"kubernetes.io/projected/51199ad2-1d9f-4951-af87-21d70591fdf7-kube-api-access-67gfc\") pod \"dns-default-xnrgn\" (UID: \"51199ad2-1d9f-4951-af87-21d70591fdf7\") " pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:45:42.196260 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.196218    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51199ad2-1d9f-4951-af87-21d70591fdf7-tmp-dir\") pod \"dns-default-xnrgn\" (UID: \"51199ad2-1d9f-4951-af87-21d70591fdf7\") " pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:45:42.196260 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.196265    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67gfc\" (UniqueName: \"kubernetes.io/projected/51199ad2-1d9f-4951-af87-21d70591fdf7-kube-api-access-67gfc\") pod \"dns-default-xnrgn\" (UID: \"51199ad2-1d9f-4951-af87-21d70591fdf7\") " pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:45:42.196874 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.196299    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7da14b29-4d93-4577-b16c-db6d30d0255e-cert\") pod \"ingress-canary-r6npp\" (UID: \"7da14b29-4d93-4577-b16c-db6d30d0255e\") " pod="openshift-ingress-canary/ingress-canary-r6npp"
Sep 11 17:45:42.196874 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.196318    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51199ad2-1d9f-4951-af87-21d70591fdf7-config-volume\") pod \"dns-default-xnrgn\" (UID: \"51199ad2-1d9f-4951-af87-21d70591fdf7\") " pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:45:42.196874 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.196369    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9cw6\" (UniqueName: \"kubernetes.io/projected/7da14b29-4d93-4577-b16c-db6d30d0255e-kube-api-access-c9cw6\") pod \"ingress-canary-r6npp\" (UID: \"7da14b29-4d93-4577-b16c-db6d30d0255e\") " pod="openshift-ingress-canary/ingress-canary-r6npp"
Sep 11 17:45:42.196874 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.196419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls\") pod \"dns-default-xnrgn\" (UID: \"51199ad2-1d9f-4951-af87-21d70591fdf7\") " pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:45:42.196874 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:42.196516    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 17:45:42.196874 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:42.196582    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls podName:51199ad2-1d9f-4951-af87-21d70591fdf7 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:42.696565202 +0000 UTC m=+35.622516928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls") pod "dns-default-xnrgn" (UID: "51199ad2-1d9f-4951-af87-21d70591fdf7") : secret "dns-default-metrics-tls" not found
Sep 11 17:45:42.196874 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.196615    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51199ad2-1d9f-4951-af87-21d70591fdf7-tmp-dir\") pod \"dns-default-xnrgn\" (UID: \"51199ad2-1d9f-4951-af87-21d70591fdf7\") " pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:45:42.197121 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.196907    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51199ad2-1d9f-4951-af87-21d70591fdf7-config-volume\") pod \"dns-default-xnrgn\" (UID: \"51199ad2-1d9f-4951-af87-21d70591fdf7\") " pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:45:42.200316 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.200299    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7da14b29-4d93-4577-b16c-db6d30d0255e-cert\") pod \"ingress-canary-r6npp\" (UID: \"7da14b29-4d93-4577-b16c-db6d30d0255e\") " pod="openshift-ingress-canary/ingress-canary-r6npp"
Sep 11 17:45:42.205271 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.205243    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9cw6\" (UniqueName: \"kubernetes.io/projected/7da14b29-4d93-4577-b16c-db6d30d0255e-kube-api-access-c9cw6\") pod \"ingress-canary-r6npp\" (UID: \"7da14b29-4d93-4577-b16c-db6d30d0255e\") " pod="openshift-ingress-canary/ingress-canary-r6npp"
Sep 11 17:45:42.205412 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.205396    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67gfc\" (UniqueName: \"kubernetes.io/projected/51199ad2-1d9f-4951-af87-21d70591fdf7-kube-api-access-67gfc\") pod \"dns-default-xnrgn\" (UID: \"51199ad2-1d9f-4951-af87-21d70591fdf7\") " pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:45:42.275501 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.275456    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r6npp"
Sep 11 17:45:42.593413 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.593380    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r6npp"]
Sep 11 17:45:42.597144 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:45:42.597122    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7da14b29_4d93_4577_b16c_db6d30d0255e.slice/crio-b7b1ea610daa32fe384214d7d9178a2836f557afc9910fe1891bbb2ec3776baf WatchSource:0}: Error finding container b7b1ea610daa32fe384214d7d9178a2836f557afc9910fe1891bbb2ec3776baf: Status 404 returned error can't find the container with id b7b1ea610daa32fe384214d7d9178a2836f557afc9910fe1891bbb2ec3776baf
Sep 11 17:45:42.698492 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.698398    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls\") pod \"dns-default-xnrgn\" (UID: \"51199ad2-1d9f-4951-af87-21d70591fdf7\") " pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:45:42.698640 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:42.698547    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 17:45:42.698640 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:42.698611    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls podName:51199ad2-1d9f-4951-af87-21d70591fdf7 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:43.698597196 +0000 UTC m=+36.624548951 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls") pod "dns-default-xnrgn" (UID: "51199ad2-1d9f-4951-af87-21d70591fdf7") : secret "dns-default-metrics-tls" not found
Sep 11 17:45:42.762690 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.762655    2579 generic.go:356] "Generic (PLEG): container finished" podID="c48582c7-77a6-40c2-b187-de7038c31e1f" containerID="86bc0cd00539ce2fc83467129e28b074daf88a267f2cfc7bd3cfe2a5009ea690" exitCode=0
Sep 11 17:45:42.762849 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.762732    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg88l" event={"ID":"c48582c7-77a6-40c2-b187-de7038c31e1f","Type":"ContainerDied","Data":"86bc0cd00539ce2fc83467129e28b074daf88a267f2cfc7bd3cfe2a5009ea690"}
Sep 11 17:45:42.763894 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:42.763855    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r6npp" event={"ID":"7da14b29-4d93-4577-b16c-db6d30d0255e","Type":"ContainerStarted","Data":"b7b1ea610daa32fe384214d7d9178a2836f557afc9910fe1891bbb2ec3776baf"}
Sep 11 17:45:43.528405 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:43.528164    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:45:43.529072 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:43.528164    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:45:43.529072 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:43.528205    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:45:43.531839 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:43.531752    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jfwbq\""
Sep 11 17:45:43.531839 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:43.531784    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 17:45:43.531839 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:43.531804    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 17:45:43.531839 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:43.531785    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 17:45:43.531839 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:43.531811    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 17:45:43.531839 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:43.531839    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7dtkl\""
Sep 11 17:45:43.707280 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:43.707246    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls\") pod \"dns-default-xnrgn\" (UID: \"51199ad2-1d9f-4951-af87-21d70591fdf7\") " pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:45:43.707456 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:43.707406    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 17:45:43.707502 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:43.707491    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls podName:51199ad2-1d9f-4951-af87-21d70591fdf7 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:45.707469536 +0000 UTC m=+38.633421275 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls") pod "dns-default-xnrgn" (UID: "51199ad2-1d9f-4951-af87-21d70591fdf7") : secret "dns-default-metrics-tls" not found
Sep 11 17:45:43.770992 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:43.770948    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg88l" event={"ID":"c48582c7-77a6-40c2-b187-de7038c31e1f","Type":"ContainerStarted","Data":"16569849001eccee3694ca06954bff8e5ce530de07d406659516b3ee990acacc"}
Sep 11 17:45:43.813251 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:43.813045    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hg88l" podStartSLOduration=8.71083973 podStartE2EDuration="36.813025141s" totalImagesPullingTime="28.102185411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:45:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:43.812576801 +0000 UTC m=+36.738528567" watchObservedRunningTime="2026-09-11 17:45:43.813025141 +0000 UTC m=+36.738976888"
Sep 11 17:45:45.724853 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:45.724751    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls\") pod \"dns-default-xnrgn\" (UID: \"51199ad2-1d9f-4951-af87-21d70591fdf7\") " pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:45:45.725193 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:45.724911    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 17:45:45.725193 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:45.724981    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls podName:51199ad2-1d9f-4951-af87-21d70591fdf7 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:49.724964683 +0000 UTC m=+42.650916427 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls") pod "dns-default-xnrgn" (UID: "51199ad2-1d9f-4951-af87-21d70591fdf7") : secret "dns-default-metrics-tls" not found
Sep 11 17:45:45.777155 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:45.777123    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r6npp" event={"ID":"7da14b29-4d93-4577-b16c-db6d30d0255e","Type":"ContainerStarted","Data":"0db9250d46b1ad5fbcfe797c4fc38b4bd84900956ca7a5a62b3ee5002ea9a742"}
Sep 11 17:45:45.793164 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:45.793122    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r6npp" podStartSLOduration=2.006734428 podStartE2EDuration="4.793105295s" totalImagesPullingTime="2.786370867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:45.792849522 +0000 UTC m=+38.718801269" watchObservedRunningTime="2026-09-11 17:45:45.793105295 +0000 UTC m=+38.719057032"
Sep 11 17:45:49.755249 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:49.755203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls\") pod \"dns-default-xnrgn\" (UID: \"51199ad2-1d9f-4951-af87-21d70591fdf7\") " pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:45:49.755655 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:49.755354    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 17:45:49.755655 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:49.755420    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls podName:51199ad2-1d9f-4951-af87-21d70591fdf7 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:57.755405067 +0000 UTC m=+50.681356791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls") pod "dns-default-xnrgn" (UID: "51199ad2-1d9f-4951-af87-21d70591fdf7") : secret "dns-default-metrics-tls" not found
Sep 11 17:45:57.809305 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:45:57.809273    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls\") pod \"dns-default-xnrgn\" (UID: \"51199ad2-1d9f-4951-af87-21d70591fdf7\") " pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:45:57.809739 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:57.809417    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 17:45:57.809739 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:45:57.809474    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls podName:51199ad2-1d9f-4951-af87-21d70591fdf7 nodeName:}" failed. No retries permitted until 2026-09-11 17:46:13.809456279 +0000 UTC m=+66.735408016 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls") pod "dns-default-xnrgn" (UID: "51199ad2-1d9f-4951-af87-21d70591fdf7") : secret "dns-default-metrics-tls" not found
Sep 11 17:46:08.755776 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:08.755741    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l7zx6"
Sep 11 17:46:13.206744 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:13.206687    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs\") pod \"network-metrics-daemon-27scn\" (UID: \"ebc8fd61-b671-4d9e-9e23-756caf55b43c\") " pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:46:13.206744 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:13.206746    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jgz9\" (UniqueName: \"kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9\") pod \"network-check-target-hjngm\" (UID: \"ca5eeb84-ac64-4191-8943-67fb065f9d90\") " pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:46:13.210051 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:13.210027    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 17:46:13.210120 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:13.210064    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 17:46:13.217936 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:13.217896    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 17:46:13.218070 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:13.217980    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs podName:ebc8fd61-b671-4d9e-9e23-756caf55b43c nodeName:}" failed. No retries permitted until 2026-09-11 17:47:17.217963639 +0000 UTC m=+130.143915363 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs") pod "network-metrics-daemon-27scn" (UID: "ebc8fd61-b671-4d9e-9e23-756caf55b43c") : secret "metrics-daemon-secret" not found
Sep 11 17:46:13.220313 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:13.220293    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 17:46:13.231877 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:13.231846    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jgz9\" (UniqueName: \"kubernetes.io/projected/ca5eeb84-ac64-4191-8943-67fb065f9d90-kube-api-access-8jgz9\") pod \"network-check-target-hjngm\" (UID: \"ca5eeb84-ac64-4191-8943-67fb065f9d90\") " pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:46:13.245812 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:13.245785    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7dtkl\""
Sep 11 17:46:13.252018 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:13.251994    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:46:13.307232 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:13.307201    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret\") pod \"global-pull-secret-syncer-fzfxg\" (UID: \"74532c4c-1206-4467-90af-b6dca8c3b5ac\") " pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:46:13.310087 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:13.310060    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 17:46:13.320337 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:13.320313    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74532c4c-1206-4467-90af-b6dca8c3b5ac-original-pull-secret\") pod \"global-pull-secret-syncer-fzfxg\" (UID: \"74532c4c-1206-4467-90af-b6dca8c3b5ac\") " pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:46:13.540393 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:13.540363    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hjngm"]
Sep 11 17:46:13.553428 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:13.553409    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzfxg"
Sep 11 17:46:13.810052 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:13.809981    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls\") pod \"dns-default-xnrgn\" (UID: \"51199ad2-1d9f-4951-af87-21d70591fdf7\") " pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:46:13.810183 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:13.810099    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 17:46:13.810183 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:13.810152    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls podName:51199ad2-1d9f-4951-af87-21d70591fdf7 nodeName:}" failed. No retries permitted until 2026-09-11 17:46:45.810138243 +0000 UTC m=+98.736089971 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls") pod "dns-default-xnrgn" (UID: "51199ad2-1d9f-4951-af87-21d70591fdf7") : secret "dns-default-metrics-tls" not found
Sep 11 17:46:13.829117 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:13.829088    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fzfxg"]
Sep 11 17:46:13.832147 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:46:13.832113    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74532c4c_1206_4467_90af_b6dca8c3b5ac.slice/crio-059eb8a1186b2457e758443cf1e6e7cc1d5f672b644ccaa5d456c2696d4abd72 WatchSource:0}: Error finding container 059eb8a1186b2457e758443cf1e6e7cc1d5f672b644ccaa5d456c2696d4abd72: Status 404 returned error can't find the container with id 059eb8a1186b2457e758443cf1e6e7cc1d5f672b644ccaa5d456c2696d4abd72
Sep 11 17:46:13.843567 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:13.843515    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fzfxg" event={"ID":"74532c4c-1206-4467-90af-b6dca8c3b5ac","Type":"ContainerStarted","Data":"059eb8a1186b2457e758443cf1e6e7cc1d5f672b644ccaa5d456c2696d4abd72"}
Sep 11 17:46:13.844682 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:13.844656    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hjngm" event={"ID":"ca5eeb84-ac64-4191-8943-67fb065f9d90","Type":"ContainerStarted","Data":"063e6b9e5d601ad2366fc836d674817930d4aa8415476968f62957d287419ccc"}
Sep 11 17:46:14.875541 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:14.875498    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td"]
Sep 11 17:46:14.877412 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:14.877393    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td"
Sep 11 17:46:14.883919 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:14.883894    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7f2wv\""
Sep 11 17:46:14.885430 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:14.885409    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 17:46:14.886695 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:14.886671    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 11 17:46:14.887334 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:14.887051    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 17:46:14.889953 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:14.887548    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 11 17:46:14.905252 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:14.905155    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td"]
Sep 11 17:46:14.918673 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:14.918514    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/971cc6c8-731b-486b-8f31-bb4d99ab2364-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-4j9td\" (UID: \"971cc6c8-731b-486b-8f31-bb4d99ab2364\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td"
Sep 11 17:46:14.918673 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:14.918549    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tmd4\" (UniqueName: \"kubernetes.io/projected/971cc6c8-731b-486b-8f31-bb4d99ab2364-kube-api-access-6tmd4\") pod \"cluster-monitoring-operator-6cd954b897-4j9td\" (UID: \"971cc6c8-731b-486b-8f31-bb4d99ab2364\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td"
Sep 11 17:46:14.918673 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:14.918578    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/971cc6c8-731b-486b-8f31-bb4d99ab2364-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-4j9td\" (UID: \"971cc6c8-731b-486b-8f31-bb4d99ab2364\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td"
Sep 11 17:46:15.021151 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.019560    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/971cc6c8-731b-486b-8f31-bb4d99ab2364-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-4j9td\" (UID: \"971cc6c8-731b-486b-8f31-bb4d99ab2364\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td"
Sep 11 17:46:15.021151 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.019616    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tmd4\" (UniqueName: \"kubernetes.io/projected/971cc6c8-731b-486b-8f31-bb4d99ab2364-kube-api-access-6tmd4\") pod \"cluster-monitoring-operator-6cd954b897-4j9td\" (UID: \"971cc6c8-731b-486b-8f31-bb4d99ab2364\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td"
Sep 11 17:46:15.021151 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.019645    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/971cc6c8-731b-486b-8f31-bb4d99ab2364-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-4j9td\" (UID: \"971cc6c8-731b-486b-8f31-bb4d99ab2364\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td"
Sep 11 17:46:15.021151 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.020418    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/971cc6c8-731b-486b-8f31-bb4d99ab2364-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-4j9td\" (UID: \"971cc6c8-731b-486b-8f31-bb4d99ab2364\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td"
Sep 11 17:46:15.021151 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:15.020596    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 17:46:15.021151 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:15.020660    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/971cc6c8-731b-486b-8f31-bb4d99ab2364-cluster-monitoring-operator-tls podName:971cc6c8-731b-486b-8f31-bb4d99ab2364 nodeName:}" failed. No retries permitted until 2026-09-11 17:46:15.520645416 +0000 UTC m=+68.446597145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/971cc6c8-731b-486b-8f31-bb4d99ab2364-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-4j9td" (UID: "971cc6c8-731b-486b-8f31-bb4d99ab2364") : secret "cluster-monitoring-operator-tls" not found
Sep 11 17:46:15.033889 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.033860    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tmd4\" (UniqueName: \"kubernetes.io/projected/971cc6c8-731b-486b-8f31-bb4d99ab2364-kube-api-access-6tmd4\") pod \"cluster-monitoring-operator-6cd954b897-4j9td\" (UID: \"971cc6c8-731b-486b-8f31-bb4d99ab2364\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td"
Sep 11 17:46:15.082874 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.082833    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-bbhjk"]
Sep 11 17:46:15.084884 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.084859    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-bbhjk"
Sep 11 17:46:15.087846 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.087811    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 11 17:46:15.088065 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.088050    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ntq8p\""
Sep 11 17:46:15.088354 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.088335    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 11 17:46:15.088713 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.088695    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 11 17:46:15.089014 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.088992    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 11 17:46:15.095172 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.095148    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 11 17:46:15.098126 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.098103    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nscqk"]
Sep 11 17:46:15.100162 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.100138    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-q546l"]
Sep 11 17:46:15.100266 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.100245    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nscqk"
Sep 11 17:46:15.101990 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.101973    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"]
Sep 11 17:46:15.102513 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.102184    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-q546l"
Sep 11 17:46:15.102513 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.102286    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 11 17:46:15.103004 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.102984    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 11 17:46:15.103094 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.103018    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-m7qcs\""
Sep 11 17:46:15.103985 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.103967    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.106220 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.105499    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 11 17:46:15.106220 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.105520    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vw6qq\""
Sep 11 17:46:15.106220 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.105689    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 11 17:46:15.106220 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.105775    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 11 17:46:15.106796 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.106778    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h7qvz\""
Sep 11 17:46:15.107252 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.107234    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 17:46:15.107801 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.107776    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 17:46:15.110626 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.110605    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 17:46:15.114946 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.114925    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 17:46:15.115972 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.115951    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-q546l"]
Sep 11 17:46:15.121385 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.121351    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-trusted-ca\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.121479 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.121402    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68psd\" (UniqueName: \"kubernetes.io/projected/03de83d9-5ba9-4e47-ab35-d3bbd80ffecb-kube-api-access-68psd\") pod \"volume-data-source-validator-86695b7cc7-nscqk\" (UID: \"03de83d9-5ba9-4e47-ab35-d3bbd80ffecb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nscqk"
Sep 11 17:46:15.121479 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.121430    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46c0eccf-9fc2-4fbf-ae39-3b1cf093b352-serving-cert\") pod \"console-operator-696884fb9c-bbhjk\" (UID: \"46c0eccf-9fc2-4fbf-ae39-3b1cf093b352\") " pod="openshift-console-operator/console-operator-696884fb9c-bbhjk"
Sep 11 17:46:15.121479 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.121458    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-ca-trust-extracted\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.121637 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.121481    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-installation-pull-secrets\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.121637 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.121511    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2wgp\" (UniqueName: \"kubernetes.io/projected/042c3351-c263-4833-a34e-a2bc9599ee2f-kube-api-access-r2wgp\") pod \"cluster-samples-operator-86499c89c4-q546l\" (UID: \"042c3351-c263-4833-a34e-a2bc9599ee2f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-q546l"
Sep 11 17:46:15.121637 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.121539    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnmsp\" (UniqueName: \"kubernetes.io/projected/46c0eccf-9fc2-4fbf-ae39-3b1cf093b352-kube-api-access-nnmsp\") pod \"console-operator-696884fb9c-bbhjk\" (UID: \"46c0eccf-9fc2-4fbf-ae39-3b1cf093b352\") " pod="openshift-console-operator/console-operator-696884fb9c-bbhjk"
Sep 11 17:46:15.121637 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.121566    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-bound-sa-token\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.121637 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.121588    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46c0eccf-9fc2-4fbf-ae39-3b1cf093b352-config\") pod \"console-operator-696884fb9c-bbhjk\" (UID: \"46c0eccf-9fc2-4fbf-ae39-3b1cf093b352\") " pod="openshift-console-operator/console-operator-696884fb9c-bbhjk"
Sep 11 17:46:15.121637 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.121615    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-image-registry-private-configuration\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.121988 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.121684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-tls\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.121988 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.121708    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlxhx\" (UniqueName: \"kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-kube-api-access-qlxhx\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.121988 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.121730    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/042c3351-c263-4833-a34e-a2bc9599ee2f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-q546l\" (UID: \"042c3351-c263-4833-a34e-a2bc9599ee2f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-q546l"
Sep 11 17:46:15.121988 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.121794    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-certificates\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.121988 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.121817    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46c0eccf-9fc2-4fbf-ae39-3b1cf093b352-trusted-ca\") pod \"console-operator-696884fb9c-bbhjk\" (UID: \"46c0eccf-9fc2-4fbf-ae39-3b1cf093b352\") " pod="openshift-console-operator/console-operator-696884fb9c-bbhjk"
Sep 11 17:46:15.122789 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.122674    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"]
Sep 11 17:46:15.153977 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.153911    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-bbhjk"]
Sep 11 17:46:15.181342 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.181305    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nscqk"]
Sep 11 17:46:15.222440 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.222402    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-ca-trust-extracted\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.222440 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.222451    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-installation-pull-secrets\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.222689 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.222483    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2wgp\" (UniqueName: \"kubernetes.io/projected/042c3351-c263-4833-a34e-a2bc9599ee2f-kube-api-access-r2wgp\") pod \"cluster-samples-operator-86499c89c4-q546l\" (UID: \"042c3351-c263-4833-a34e-a2bc9599ee2f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-q546l"
Sep 11 17:46:15.222689 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.222509    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnmsp\" (UniqueName: \"kubernetes.io/projected/46c0eccf-9fc2-4fbf-ae39-3b1cf093b352-kube-api-access-nnmsp\") pod \"console-operator-696884fb9c-bbhjk\" (UID: \"46c0eccf-9fc2-4fbf-ae39-3b1cf093b352\") " pod="openshift-console-operator/console-operator-696884fb9c-bbhjk"
Sep 11 17:46:15.222689 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.222576    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-bound-sa-token\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.222689 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.222600    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46c0eccf-9fc2-4fbf-ae39-3b1cf093b352-config\") pod \"console-operator-696884fb9c-bbhjk\" (UID: \"46c0eccf-9fc2-4fbf-ae39-3b1cf093b352\") " pod="openshift-console-operator/console-operator-696884fb9c-bbhjk"
Sep 11 17:46:15.222689 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.222625    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-image-registry-private-configuration\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.222689 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.222686    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-tls\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.223024 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.222701    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlxhx\" (UniqueName: \"kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-kube-api-access-qlxhx\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.223024 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.222716    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/042c3351-c263-4833-a34e-a2bc9599ee2f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-q546l\" (UID: \"042c3351-c263-4833-a34e-a2bc9599ee2f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-q546l"
Sep 11 17:46:15.223024 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.222746    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-certificates\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.223024 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.222771    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46c0eccf-9fc2-4fbf-ae39-3b1cf093b352-trusted-ca\") pod \"console-operator-696884fb9c-bbhjk\" (UID: \"46c0eccf-9fc2-4fbf-ae39-3b1cf093b352\") " pod="openshift-console-operator/console-operator-696884fb9c-bbhjk"
Sep 11 17:46:15.223024 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.222800    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-trusted-ca\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.223024 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.222831    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68psd\" (UniqueName: \"kubernetes.io/projected/03de83d9-5ba9-4e47-ab35-d3bbd80ffecb-kube-api-access-68psd\") pod \"volume-data-source-validator-86695b7cc7-nscqk\" (UID: \"03de83d9-5ba9-4e47-ab35-d3bbd80ffecb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nscqk"
Sep 11 17:46:15.223024 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.222853    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46c0eccf-9fc2-4fbf-ae39-3b1cf093b352-serving-cert\") pod \"console-operator-696884fb9c-bbhjk\" (UID: \"46c0eccf-9fc2-4fbf-ae39-3b1cf093b352\") " pod="openshift-console-operator/console-operator-696884fb9c-bbhjk"
Sep 11 17:46:15.223359 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.223234    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-ca-trust-extracted\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.223984 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.223942    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-certificates\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.224218 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.224187    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46c0eccf-9fc2-4fbf-ae39-3b1cf093b352-config\") pod \"console-operator-696884fb9c-bbhjk\" (UID: \"46c0eccf-9fc2-4fbf-ae39-3b1cf093b352\") " pod="openshift-console-operator/console-operator-696884fb9c-bbhjk"
Sep 11 17:46:15.224308 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:15.224280    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 17:46:15.224308 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:15.224286    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 17:46:15.224308 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:15.224297    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b6f54f7f7-ctmbc: secret "image-registry-tls" not found
Sep 11 17:46:15.224463 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:15.224345    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042c3351-c263-4833-a34e-a2bc9599ee2f-samples-operator-tls podName:042c3351-c263-4833-a34e-a2bc9599ee2f nodeName:}" failed. No retries permitted until 2026-09-11 17:46:15.724327472 +0000 UTC m=+68.650279209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/042c3351-c263-4833-a34e-a2bc9599ee2f-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-q546l" (UID: "042c3351-c263-4833-a34e-a2bc9599ee2f") : secret "samples-operator-tls" not found
Sep 11 17:46:15.224463 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:15.224365    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-tls podName:e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd nodeName:}" failed. No retries permitted until 2026-09-11 17:46:15.72435444 +0000 UTC m=+68.650306170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-tls") pod "image-registry-5b6f54f7f7-ctmbc" (UID: "e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd") : secret "image-registry-tls" not found
Sep 11 17:46:15.224751 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.224721    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46c0eccf-9fc2-4fbf-ae39-3b1cf093b352-trusted-ca\") pod \"console-operator-696884fb9c-bbhjk\" (UID: \"46c0eccf-9fc2-4fbf-ae39-3b1cf093b352\") " pod="openshift-console-operator/console-operator-696884fb9c-bbhjk"
Sep 11 17:46:15.225152 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.225089    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-trusted-ca\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.226178 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.226138    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46c0eccf-9fc2-4fbf-ae39-3b1cf093b352-serving-cert\") pod \"console-operator-696884fb9c-bbhjk\" (UID: \"46c0eccf-9fc2-4fbf-ae39-3b1cf093b352\") " pod="openshift-console-operator/console-operator-696884fb9c-bbhjk"
Sep 11 17:46:15.226438 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.226418    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-installation-pull-secrets\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.227033 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.226990    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-image-registry-private-configuration\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.249141 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.249083    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68psd\" (UniqueName: \"kubernetes.io/projected/03de83d9-5ba9-4e47-ab35-d3bbd80ffecb-kube-api-access-68psd\") pod \"volume-data-source-validator-86695b7cc7-nscqk\" (UID: \"03de83d9-5ba9-4e47-ab35-d3bbd80ffecb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nscqk"
Sep 11 17:46:15.251130 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.250820    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnmsp\" (UniqueName: \"kubernetes.io/projected/46c0eccf-9fc2-4fbf-ae39-3b1cf093b352-kube-api-access-nnmsp\") pod \"console-operator-696884fb9c-bbhjk\" (UID: \"46c0eccf-9fc2-4fbf-ae39-3b1cf093b352\") " pod="openshift-console-operator/console-operator-696884fb9c-bbhjk"
Sep 11 17:46:15.251130 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.251088    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-bound-sa-token\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.251933 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.251887    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlxhx\" (UniqueName: \"kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-kube-api-access-qlxhx\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.252996 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.252971    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2wgp\" (UniqueName: \"kubernetes.io/projected/042c3351-c263-4833-a34e-a2bc9599ee2f-kube-api-access-r2wgp\") pod \"cluster-samples-operator-86499c89c4-q546l\" (UID: \"042c3351-c263-4833-a34e-a2bc9599ee2f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-q546l"
Sep 11 17:46:15.397236 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.397153    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-bbhjk"
Sep 11 17:46:15.414932 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.414902    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nscqk"
Sep 11 17:46:15.524793 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.524735    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/971cc6c8-731b-486b-8f31-bb4d99ab2364-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-4j9td\" (UID: \"971cc6c8-731b-486b-8f31-bb4d99ab2364\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td"
Sep 11 17:46:15.524975 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:15.524906    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 17:46:15.525037 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:15.524987    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/971cc6c8-731b-486b-8f31-bb4d99ab2364-cluster-monitoring-operator-tls podName:971cc6c8-731b-486b-8f31-bb4d99ab2364 nodeName:}" failed. No retries permitted until 2026-09-11 17:46:16.524965313 +0000 UTC m=+69.450917036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/971cc6c8-731b-486b-8f31-bb4d99ab2364-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-4j9td" (UID: "971cc6c8-731b-486b-8f31-bb4d99ab2364") : secret "cluster-monitoring-operator-tls" not found
Sep 11 17:46:15.680866 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.680755    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-bbhjk"]
Sep 11 17:46:15.684682 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:46:15.684611    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c0eccf_9fc2_4fbf_ae39_3b1cf093b352.slice/crio-4c53faf0b8ce5d0fcb370cd314624133c9ea38f1692b3d91c2529a4478401fe7 WatchSource:0}: Error finding container 4c53faf0b8ce5d0fcb370cd314624133c9ea38f1692b3d91c2529a4478401fe7: Status 404 returned error can't find the container with id 4c53faf0b8ce5d0fcb370cd314624133c9ea38f1692b3d91c2529a4478401fe7
Sep 11 17:46:15.702230 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.702150    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nscqk"]
Sep 11 17:46:15.706012 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:46:15.705974    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03de83d9_5ba9_4e47_ab35_d3bbd80ffecb.slice/crio-81677613f9338927ef2382b48be05e5447ac189d591bad9ebb2103baf4c6cf69 WatchSource:0}: Error finding container 81677613f9338927ef2382b48be05e5447ac189d591bad9ebb2103baf4c6cf69: Status 404 returned error can't find the container with id 81677613f9338927ef2382b48be05e5447ac189d591bad9ebb2103baf4c6cf69
Sep 11 17:46:15.726520 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.726448    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-tls\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:15.726520 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.726493    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/042c3351-c263-4833-a34e-a2bc9599ee2f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-q546l\" (UID: \"042c3351-c263-4833-a34e-a2bc9599ee2f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-q546l"
Sep 11 17:46:15.726754 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:15.726574    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 17:46:15.726754 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:15.726596    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b6f54f7f7-ctmbc: secret "image-registry-tls" not found
Sep 11 17:46:15.726754 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:15.726658    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 17:46:15.726754 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:15.726676    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-tls podName:e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd nodeName:}" failed. No retries permitted until 2026-09-11 17:46:16.726656284 +0000 UTC m=+69.652608019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-tls") pod "image-registry-5b6f54f7f7-ctmbc" (UID: "e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd") : secret "image-registry-tls" not found
Sep 11 17:46:15.726754 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:15.726774    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042c3351-c263-4833-a34e-a2bc9599ee2f-samples-operator-tls podName:042c3351-c263-4833-a34e-a2bc9599ee2f nodeName:}" failed. No retries permitted until 2026-09-11 17:46:16.726739142 +0000 UTC m=+69.652690882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/042c3351-c263-4833-a34e-a2bc9599ee2f-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-q546l" (UID: "042c3351-c263-4833-a34e-a2bc9599ee2f") : secret "samples-operator-tls" not found
Sep 11 17:46:15.852954 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.852907    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nscqk" event={"ID":"03de83d9-5ba9-4e47-ab35-d3bbd80ffecb","Type":"ContainerStarted","Data":"81677613f9338927ef2382b48be05e5447ac189d591bad9ebb2103baf4c6cf69"}
Sep 11 17:46:15.854455 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:15.854425    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-bbhjk" event={"ID":"46c0eccf-9fc2-4fbf-ae39-3b1cf093b352","Type":"ContainerStarted","Data":"4c53faf0b8ce5d0fcb370cd314624133c9ea38f1692b3d91c2529a4478401fe7"}
Sep 11 17:46:16.531643 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:16.531480    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/971cc6c8-731b-486b-8f31-bb4d99ab2364-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-4j9td\" (UID: \"971cc6c8-731b-486b-8f31-bb4d99ab2364\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td"
Sep 11 17:46:16.532123 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:16.531715    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 17:46:16.532123 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:16.531802    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/971cc6c8-731b-486b-8f31-bb4d99ab2364-cluster-monitoring-operator-tls podName:971cc6c8-731b-486b-8f31-bb4d99ab2364 nodeName:}" failed. No retries permitted until 2026-09-11 17:46:18.531782705 +0000 UTC m=+71.457734432 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/971cc6c8-731b-486b-8f31-bb4d99ab2364-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-4j9td" (UID: "971cc6c8-731b-486b-8f31-bb4d99ab2364") : secret "cluster-monitoring-operator-tls" not found
Sep 11 17:46:16.733286 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:16.733247    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-tls\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:16.733485 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:16.733298    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/042c3351-c263-4833-a34e-a2bc9599ee2f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-q546l\" (UID: \"042c3351-c263-4833-a34e-a2bc9599ee2f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-q546l"
Sep 11 17:46:16.733485 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:16.733445    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 17:46:16.733583 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:16.733510    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042c3351-c263-4833-a34e-a2bc9599ee2f-samples-operator-tls podName:042c3351-c263-4833-a34e-a2bc9599ee2f nodeName:}" failed. No retries permitted until 2026-09-11 17:46:18.733490979 +0000 UTC m=+71.659442707 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/042c3351-c263-4833-a34e-a2bc9599ee2f-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-q546l" (UID: "042c3351-c263-4833-a34e-a2bc9599ee2f") : secret "samples-operator-tls" not found
Sep 11 17:46:16.733583 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:16.733449    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 17:46:16.733583 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:16.733536    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b6f54f7f7-ctmbc: secret "image-registry-tls" not found
Sep 11 17:46:16.733583 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:16.733575    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-tls podName:e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd nodeName:}" failed. No retries permitted until 2026-09-11 17:46:18.733564073 +0000 UTC m=+71.659515818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-tls") pod "image-registry-5b6f54f7f7-ctmbc" (UID: "e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd") : secret "image-registry-tls" not found
Sep 11 17:46:18.548515 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:18.548475    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/971cc6c8-731b-486b-8f31-bb4d99ab2364-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-4j9td\" (UID: \"971cc6c8-731b-486b-8f31-bb4d99ab2364\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td"
Sep 11 17:46:18.548994 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:18.548616    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 17:46:18.548994 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:18.548692    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/971cc6c8-731b-486b-8f31-bb4d99ab2364-cluster-monitoring-operator-tls podName:971cc6c8-731b-486b-8f31-bb4d99ab2364 nodeName:}" failed. No retries permitted until 2026-09-11 17:46:22.548671408 +0000 UTC m=+75.474623132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/971cc6c8-731b-486b-8f31-bb4d99ab2364-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-4j9td" (UID: "971cc6c8-731b-486b-8f31-bb4d99ab2364") : secret "cluster-monitoring-operator-tls" not found
Sep 11 17:46:18.749617 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:18.749574    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-tls\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:18.749849 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:18.749625    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/042c3351-c263-4833-a34e-a2bc9599ee2f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-q546l\" (UID: \"042c3351-c263-4833-a34e-a2bc9599ee2f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-q546l"
Sep 11 17:46:18.749849 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:18.749733    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 17:46:18.749849 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:18.749753    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b6f54f7f7-ctmbc: secret "image-registry-tls" not found
Sep 11 17:46:18.749849 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:18.749805    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 17:46:18.749849 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:18.749846    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-tls podName:e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd nodeName:}" failed. No retries permitted until 2026-09-11 17:46:22.749824944 +0000 UTC m=+75.675776707 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-tls") pod "image-registry-5b6f54f7f7-ctmbc" (UID: "e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd") : secret "image-registry-tls" not found
Sep 11 17:46:18.750113 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:18.749872    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042c3351-c263-4833-a34e-a2bc9599ee2f-samples-operator-tls podName:042c3351-c263-4833-a34e-a2bc9599ee2f nodeName:}" failed. No retries permitted until 2026-09-11 17:46:22.749854003 +0000 UTC m=+75.675805732 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/042c3351-c263-4833-a34e-a2bc9599ee2f-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-q546l" (UID: "042c3351-c263-4833-a34e-a2bc9599ee2f") : secret "samples-operator-tls" not found
Sep 11 17:46:19.866942 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:19.866897    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fzfxg" event={"ID":"74532c4c-1206-4467-90af-b6dca8c3b5ac","Type":"ContainerStarted","Data":"56f4703be54ffeec1c651f4683e381b6a81b384a7051990c9dc5c4899e21b97b"}
Sep 11 17:46:19.868428 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:19.868400    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nscqk" event={"ID":"03de83d9-5ba9-4e47-ab35-d3bbd80ffecb","Type":"ContainerStarted","Data":"54e22c5ed37cbd9f685081b4bd478eacc931f2d3b010f3b46a2425e554744924"}
Sep 11 17:46:19.869791 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:19.869753    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hjngm" event={"ID":"ca5eeb84-ac64-4191-8943-67fb065f9d90","Type":"ContainerStarted","Data":"37f5f1c2dd08ceb6230676a89e2431f08e9c9d5f6a90ab3d5b31f3ff3405321a"}
Sep 11 17:46:19.869884 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:19.869847    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:46:19.871319 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:19.871300    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-bbhjk_46c0eccf-9fc2-4fbf-ae39-3b1cf093b352/console-operator/0.log"
Sep 11 17:46:19.871412 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:19.871338    2579 generic.go:356] "Generic (PLEG): container finished" podID="46c0eccf-9fc2-4fbf-ae39-3b1cf093b352" containerID="942e14cd15b78c6df3cc9ef5902cfdc76688064d3ee5964b4c50b0cec16f42b7" exitCode=255
Sep 11 17:46:19.871412 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:19.871380    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-bbhjk" event={"ID":"46c0eccf-9fc2-4fbf-ae39-3b1cf093b352","Type":"ContainerDied","Data":"942e14cd15b78c6df3cc9ef5902cfdc76688064d3ee5964b4c50b0cec16f42b7"}
Sep 11 17:46:19.871574 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:19.871561    2579 scope.go:117] "RemoveContainer" containerID="942e14cd15b78c6df3cc9ef5902cfdc76688064d3ee5964b4c50b0cec16f42b7"
Sep 11 17:46:19.891241 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:19.891195    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fzfxg" podStartSLOduration=67.583321597 podStartE2EDuration="1m12.891180029s" totalImagesPullingTime="5.307858432s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:46:19.889970416 +0000 UTC m=+72.815922170" watchObservedRunningTime="2026-09-11 17:46:19.891180029 +0000 UTC m=+72.817131774"
Sep 11 17:46:19.930917 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:19.930869    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nscqk" podStartSLOduration=1.4894586109999999 podStartE2EDuration="4.930850129s" totalImagesPullingTime="3.441391518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:46:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:46:19.930753832 +0000 UTC m=+72.856705577" watchObservedRunningTime="2026-09-11 17:46:19.930850129 +0000 UTC m=+72.856801875"
Sep 11 17:46:19.948578 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:19.948533    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hjngm" podStartSLOduration=67.349024008 podStartE2EDuration="1m12.948517987s" totalImagesPullingTime="5.599493979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:46:19.947113025 +0000 UTC m=+72.873064782" watchObservedRunningTime="2026-09-11 17:46:19.948517987 +0000 UTC m=+72.874469733"
Sep 11 17:46:20.421569 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.421529    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z5565"]
Sep 11 17:46:20.424145 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.424123    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:20.426867 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.426843    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 17:46:20.426954 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.426849    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2rwzx\""
Sep 11 17:46:20.427388 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.427373    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 17:46:20.427436 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.427381    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 17:46:20.427476 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.427377    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 17:46:20.439248 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.439224    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z5565"]
Sep 11 17:46:20.464695 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.464659    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx59v\" (UniqueName: \"kubernetes.io/projected/084f613d-75ac-40dd-bc1f-e883a576851b-kube-api-access-kx59v\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:20.464896 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.464727    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/084f613d-75ac-40dd-bc1f-e883a576851b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:20.464896 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.464879    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/084f613d-75ac-40dd-bc1f-e883a576851b-crio-socket\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:20.465017 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.464916    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/084f613d-75ac-40dd-bc1f-e883a576851b-data-volume\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:20.465017 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.464943    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/084f613d-75ac-40dd-bc1f-e883a576851b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:20.562013 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.561977    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-krhbl"]
Sep 11 17:46:20.564994 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.564979    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-krhbl"
Sep 11 17:46:20.565280 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.565258    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/084f613d-75ac-40dd-bc1f-e883a576851b-crio-socket\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:20.565356 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.565294    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/084f613d-75ac-40dd-bc1f-e883a576851b-data-volume\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:20.565356 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.565322    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/084f613d-75ac-40dd-bc1f-e883a576851b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:20.565356 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.565342    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/084f613d-75ac-40dd-bc1f-e883a576851b-crio-socket\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:20.565525 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.565393    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx59v\" (UniqueName: \"kubernetes.io/projected/084f613d-75ac-40dd-bc1f-e883a576851b-kube-api-access-kx59v\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:20.565525 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:20.565452    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 17:46:20.565525 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.565472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/084f613d-75ac-40dd-bc1f-e883a576851b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:20.565525 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:20.565512    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084f613d-75ac-40dd-bc1f-e883a576851b-insights-runtime-extractor-tls podName:084f613d-75ac-40dd-bc1f-e883a576851b nodeName:}" failed. No retries permitted until 2026-09-11 17:46:21.065498648 +0000 UTC m=+73.991450391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/084f613d-75ac-40dd-bc1f-e883a576851b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z5565" (UID: "084f613d-75ac-40dd-bc1f-e883a576851b") : secret "insights-runtime-extractor-tls" not found
Sep 11 17:46:20.565709 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:20.565566    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 17:46:20.565709 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:20.565641    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/084f613d-75ac-40dd-bc1f-e883a576851b-kube-rbac-proxy-cm podName:084f613d-75ac-40dd-bc1f-e883a576851b nodeName:}" failed. No retries permitted until 2026-09-11 17:46:21.065624341 +0000 UTC m=+73.991576079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/084f613d-75ac-40dd-bc1f-e883a576851b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z5565" (UID: "084f613d-75ac-40dd-bc1f-e883a576851b") : configmap "kube-rbac-proxy" not found
Sep 11 17:46:20.566006 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.565985    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/084f613d-75ac-40dd-bc1f-e883a576851b-data-volume\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:20.568319 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.568299    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5qgfl\""
Sep 11 17:46:20.568389 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.568344    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 11 17:46:20.568438 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.568304    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 11 17:46:20.582738 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.582713    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx59v\" (UniqueName: \"kubernetes.io/projected/084f613d-75ac-40dd-bc1f-e883a576851b-kube-api-access-kx59v\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:20.659439 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.659402    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-krhbl"]
Sep 11 17:46:20.666450 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.666425    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln76q\" (UniqueName: \"kubernetes.io/projected/a22efa0a-d1db-489d-a75a-e602890932ec-kube-api-access-ln76q\") pod \"migrator-8b4d697c5-krhbl\" (UID: \"a22efa0a-d1db-489d-a75a-e602890932ec\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-krhbl"
Sep 11 17:46:20.767219 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.767187    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln76q\" (UniqueName: \"kubernetes.io/projected/a22efa0a-d1db-489d-a75a-e602890932ec-kube-api-access-ln76q\") pod \"migrator-8b4d697c5-krhbl\" (UID: \"a22efa0a-d1db-489d-a75a-e602890932ec\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-krhbl"
Sep 11 17:46:20.776193 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.776171    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln76q\" (UniqueName: \"kubernetes.io/projected/a22efa0a-d1db-489d-a75a-e602890932ec-kube-api-access-ln76q\") pod \"migrator-8b4d697c5-krhbl\" (UID: \"a22efa0a-d1db-489d-a75a-e602890932ec\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-krhbl"
Sep 11 17:46:20.872985 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.872958    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-krhbl"
Sep 11 17:46:20.876449 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.876140    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-bbhjk_46c0eccf-9fc2-4fbf-ae39-3b1cf093b352/console-operator/1.log"
Sep 11 17:46:20.876566 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.876535    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-bbhjk_46c0eccf-9fc2-4fbf-ae39-3b1cf093b352/console-operator/0.log"
Sep 11 17:46:20.876626 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.876581    2579 generic.go:356] "Generic (PLEG): container finished" podID="46c0eccf-9fc2-4fbf-ae39-3b1cf093b352" containerID="e9e2a494ccfdad0c2810595aecce2118603287e21c0a94b5497f72d850024b96" exitCode=255
Sep 11 17:46:20.876684 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.876671    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-bbhjk" event={"ID":"46c0eccf-9fc2-4fbf-ae39-3b1cf093b352","Type":"ContainerDied","Data":"e9e2a494ccfdad0c2810595aecce2118603287e21c0a94b5497f72d850024b96"}
Sep 11 17:46:20.876733 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.876715    2579 scope.go:117] "RemoveContainer" containerID="942e14cd15b78c6df3cc9ef5902cfdc76688064d3ee5964b4c50b0cec16f42b7"
Sep 11 17:46:20.876954 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:20.876932    2579 scope.go:117] "RemoveContainer" containerID="e9e2a494ccfdad0c2810595aecce2118603287e21c0a94b5497f72d850024b96"
Sep 11 17:46:20.877130 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:20.877107    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-bbhjk_openshift-console-operator(46c0eccf-9fc2-4fbf-ae39-3b1cf093b352)\"" pod="openshift-console-operator/console-operator-696884fb9c-bbhjk" podUID="46c0eccf-9fc2-4fbf-ae39-3b1cf093b352"
Sep 11 17:46:21.070619 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:21.070526    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/084f613d-75ac-40dd-bc1f-e883a576851b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:21.070619 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:21.070593    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/084f613d-75ac-40dd-bc1f-e883a576851b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:21.070894 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:21.070652    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 17:46:21.070894 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:21.070667    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 17:46:21.070894 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:21.070724    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/084f613d-75ac-40dd-bc1f-e883a576851b-kube-rbac-proxy-cm podName:084f613d-75ac-40dd-bc1f-e883a576851b nodeName:}" failed. No retries permitted until 2026-09-11 17:46:22.070706407 +0000 UTC m=+74.996658146 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/084f613d-75ac-40dd-bc1f-e883a576851b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z5565" (UID: "084f613d-75ac-40dd-bc1f-e883a576851b") : configmap "kube-rbac-proxy" not found
Sep 11 17:46:21.070894 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:21.070745    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084f613d-75ac-40dd-bc1f-e883a576851b-insights-runtime-extractor-tls podName:084f613d-75ac-40dd-bc1f-e883a576851b nodeName:}" failed. No retries permitted until 2026-09-11 17:46:22.070734993 +0000 UTC m=+74.996686717 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/084f613d-75ac-40dd-bc1f-e883a576851b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z5565" (UID: "084f613d-75ac-40dd-bc1f-e883a576851b") : secret "insights-runtime-extractor-tls" not found
Sep 11 17:46:21.157793 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:21.157741    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-krhbl"]
Sep 11 17:46:21.160343 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:46:21.160320    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda22efa0a_d1db_489d_a75a_e602890932ec.slice/crio-653879369f37ebdeb3e273e3b713ee9d9f13e00ce00dfb81a2528142499ca35a WatchSource:0}: Error finding container 653879369f37ebdeb3e273e3b713ee9d9f13e00ce00dfb81a2528142499ca35a: Status 404 returned error can't find the container with id 653879369f37ebdeb3e273e3b713ee9d9f13e00ce00dfb81a2528142499ca35a
Sep 11 17:46:21.882062 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:21.882032    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-bbhjk_46c0eccf-9fc2-4fbf-ae39-3b1cf093b352/console-operator/1.log"
Sep 11 17:46:21.882506 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:21.882429    2579 scope.go:117] "RemoveContainer" containerID="e9e2a494ccfdad0c2810595aecce2118603287e21c0a94b5497f72d850024b96"
Sep 11 17:46:21.882601 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:21.882582    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-bbhjk_openshift-console-operator(46c0eccf-9fc2-4fbf-ae39-3b1cf093b352)\"" pod="openshift-console-operator/console-operator-696884fb9c-bbhjk" podUID="46c0eccf-9fc2-4fbf-ae39-3b1cf093b352"
Sep 11 17:46:21.883493 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:21.883467    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-krhbl" event={"ID":"a22efa0a-d1db-489d-a75a-e602890932ec","Type":"ContainerStarted","Data":"653879369f37ebdeb3e273e3b713ee9d9f13e00ce00dfb81a2528142499ca35a"}
Sep 11 17:46:22.079578 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:22.079541    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/084f613d-75ac-40dd-bc1f-e883a576851b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:22.079780 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:22.079610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/084f613d-75ac-40dd-bc1f-e883a576851b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:22.079780 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:22.079678    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 17:46:22.079780 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:22.079738    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 17:46:22.079780 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:22.079750    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/084f613d-75ac-40dd-bc1f-e883a576851b-kube-rbac-proxy-cm podName:084f613d-75ac-40dd-bc1f-e883a576851b nodeName:}" failed. No retries permitted until 2026-09-11 17:46:24.079734901 +0000 UTC m=+77.005686628 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/084f613d-75ac-40dd-bc1f-e883a576851b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z5565" (UID: "084f613d-75ac-40dd-bc1f-e883a576851b") : configmap "kube-rbac-proxy" not found
Sep 11 17:46:22.079970 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:22.079802    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084f613d-75ac-40dd-bc1f-e883a576851b-insights-runtime-extractor-tls podName:084f613d-75ac-40dd-bc1f-e883a576851b nodeName:}" failed. No retries permitted until 2026-09-11 17:46:24.079785031 +0000 UTC m=+77.005736758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/084f613d-75ac-40dd-bc1f-e883a576851b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z5565" (UID: "084f613d-75ac-40dd-bc1f-e883a576851b") : secret "insights-runtime-extractor-tls" not found
Sep 11 17:46:22.383138 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:22.383115    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m8n8w_bc2786c3-ff15-4108-b6df-ef1852972821/dns-node-resolver/0.log"
Sep 11 17:46:22.584351 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:22.584273    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/971cc6c8-731b-486b-8f31-bb4d99ab2364-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-4j9td\" (UID: \"971cc6c8-731b-486b-8f31-bb4d99ab2364\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td"
Sep 11 17:46:22.584483 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:22.584417    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 17:46:22.584483 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:22.584480    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/971cc6c8-731b-486b-8f31-bb4d99ab2364-cluster-monitoring-operator-tls podName:971cc6c8-731b-486b-8f31-bb4d99ab2364 nodeName:}" failed. No retries permitted until 2026-09-11 17:46:30.584465294 +0000 UTC m=+83.510417038 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/971cc6c8-731b-486b-8f31-bb4d99ab2364-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-4j9td" (UID: "971cc6c8-731b-486b-8f31-bb4d99ab2364") : secret "cluster-monitoring-operator-tls" not found
Sep 11 17:46:22.786754 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:22.786711    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-tls\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:22.786958 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:22.786816    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/042c3351-c263-4833-a34e-a2bc9599ee2f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-q546l\" (UID: \"042c3351-c263-4833-a34e-a2bc9599ee2f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-q546l"
Sep 11 17:46:22.786958 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:22.786874    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 17:46:22.786958 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:22.786897    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b6f54f7f7-ctmbc: secret "image-registry-tls" not found
Sep 11 17:46:22.786958 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:22.786903    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 17:46:22.787115 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:22.786962    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-tls podName:e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd nodeName:}" failed. No retries permitted until 2026-09-11 17:46:30.78694134 +0000 UTC m=+83.712893078 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-tls") pod "image-registry-5b6f54f7f7-ctmbc" (UID: "e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd") : secret "image-registry-tls" not found
Sep 11 17:46:22.787115 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:22.786982    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042c3351-c263-4833-a34e-a2bc9599ee2f-samples-operator-tls podName:042c3351-c263-4833-a34e-a2bc9599ee2f nodeName:}" failed. No retries permitted until 2026-09-11 17:46:30.78697302 +0000 UTC m=+83.712924763 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/042c3351-c263-4833-a34e-a2bc9599ee2f-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-q546l" (UID: "042c3351-c263-4833-a34e-a2bc9599ee2f") : secret "samples-operator-tls" not found
Sep 11 17:46:22.888617 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:22.888529    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-krhbl" event={"ID":"a22efa0a-d1db-489d-a75a-e602890932ec","Type":"ContainerStarted","Data":"ff8924834335bb6c6d9fae8759fc9f68f88ebbc8d150398099a07d5ba2058e5e"}
Sep 11 17:46:22.888617 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:22.888608    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-krhbl" event={"ID":"a22efa0a-d1db-489d-a75a-e602890932ec","Type":"ContainerStarted","Data":"14a8f5a2641cdadc95bcf01280aa5ce5d0de964667c71706e9d617527324395e"}
Sep 11 17:46:23.175158 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:23.175080    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6pqzm_73e0fe43-f7e6-4418-b6c2-2f26221c994d/node-ca/0.log"
Sep 11 17:46:24.097573 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:24.097532    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/084f613d-75ac-40dd-bc1f-e883a576851b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:24.097995 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:24.097596    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/084f613d-75ac-40dd-bc1f-e883a576851b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:24.097995 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:24.097658    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 17:46:24.097995 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:24.097675    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 17:46:24.097995 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:24.097723    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/084f613d-75ac-40dd-bc1f-e883a576851b-kube-rbac-proxy-cm podName:084f613d-75ac-40dd-bc1f-e883a576851b nodeName:}" failed. No retries permitted until 2026-09-11 17:46:28.097709167 +0000 UTC m=+81.023660891 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/084f613d-75ac-40dd-bc1f-e883a576851b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z5565" (UID: "084f613d-75ac-40dd-bc1f-e883a576851b") : configmap "kube-rbac-proxy" not found
Sep 11 17:46:24.097995 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:24.097740    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084f613d-75ac-40dd-bc1f-e883a576851b-insights-runtime-extractor-tls podName:084f613d-75ac-40dd-bc1f-e883a576851b nodeName:}" failed. No retries permitted until 2026-09-11 17:46:28.097734516 +0000 UTC m=+81.023686239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/084f613d-75ac-40dd-bc1f-e883a576851b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z5565" (UID: "084f613d-75ac-40dd-bc1f-e883a576851b") : secret "insights-runtime-extractor-tls" not found
Sep 11 17:46:24.175706 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:24.175676    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r6npp_7da14b29-4d93-4577-b16c-db6d30d0255e/serve-healthcheck-canary/0.log"
Sep 11 17:46:25.397531 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:25.397486    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-bbhjk"
Sep 11 17:46:25.398051 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:25.397564    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-bbhjk"
Sep 11 17:46:25.398051 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:25.398000    2579 scope.go:117] "RemoveContainer" containerID="e9e2a494ccfdad0c2810595aecce2118603287e21c0a94b5497f72d850024b96"
Sep 11 17:46:25.398210 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:25.398187    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-bbhjk_openshift-console-operator(46c0eccf-9fc2-4fbf-ae39-3b1cf093b352)\"" pod="openshift-console-operator/console-operator-696884fb9c-bbhjk" podUID="46c0eccf-9fc2-4fbf-ae39-3b1cf093b352"
Sep 11 17:46:28.130777 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:28.130700    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/084f613d-75ac-40dd-bc1f-e883a576851b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:28.131236 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:28.130831    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/084f613d-75ac-40dd-bc1f-e883a576851b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:28.131236 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:28.130855    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 17:46:28.131236 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:28.130919    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/084f613d-75ac-40dd-bc1f-e883a576851b-kube-rbac-proxy-cm podName:084f613d-75ac-40dd-bc1f-e883a576851b nodeName:}" failed. No retries permitted until 2026-09-11 17:46:36.130904037 +0000 UTC m=+89.056855784 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/084f613d-75ac-40dd-bc1f-e883a576851b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z5565" (UID: "084f613d-75ac-40dd-bc1f-e883a576851b") : configmap "kube-rbac-proxy" not found
Sep 11 17:46:28.131236 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:28.131007    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 17:46:28.131236 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:28.131080    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084f613d-75ac-40dd-bc1f-e883a576851b-insights-runtime-extractor-tls podName:084f613d-75ac-40dd-bc1f-e883a576851b nodeName:}" failed. No retries permitted until 2026-09-11 17:46:36.131060037 +0000 UTC m=+89.057011785 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/084f613d-75ac-40dd-bc1f-e883a576851b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z5565" (UID: "084f613d-75ac-40dd-bc1f-e883a576851b") : secret "insights-runtime-extractor-tls" not found
Sep 11 17:46:30.651420 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:30.651292    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/971cc6c8-731b-486b-8f31-bb4d99ab2364-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-4j9td\" (UID: \"971cc6c8-731b-486b-8f31-bb4d99ab2364\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td"
Sep 11 17:46:30.651819 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:30.651441    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 17:46:30.651819 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:46:30.651503    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/971cc6c8-731b-486b-8f31-bb4d99ab2364-cluster-monitoring-operator-tls podName:971cc6c8-731b-486b-8f31-bb4d99ab2364 nodeName:}" failed. No retries permitted until 2026-09-11 17:46:46.65148819 +0000 UTC m=+99.577439928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/971cc6c8-731b-486b-8f31-bb4d99ab2364-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-4j9td" (UID: "971cc6c8-731b-486b-8f31-bb4d99ab2364") : secret "cluster-monitoring-operator-tls" not found
Sep 11 17:46:30.853487 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:30.853450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-tls\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:30.853687 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:30.853517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/042c3351-c263-4833-a34e-a2bc9599ee2f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-q546l\" (UID: \"042c3351-c263-4833-a34e-a2bc9599ee2f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-q546l"
Sep 11 17:46:30.855983 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:30.855954    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/042c3351-c263-4833-a34e-a2bc9599ee2f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-q546l\" (UID: \"042c3351-c263-4833-a34e-a2bc9599ee2f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-q546l"
Sep 11 17:46:30.856116 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:30.855954    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-tls\") pod \"image-registry-5b6f54f7f7-ctmbc\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") " pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:31.025155 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:31.025109    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-q546l"
Sep 11 17:46:31.032386 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:31.032358    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:31.321440 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:31.321341    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-krhbl" podStartSLOduration=10.195474014 podStartE2EDuration="11.321322634s" totalImagesPullingTime="1.12584862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:46:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:46:22.933109614 +0000 UTC m=+75.859061358" watchObservedRunningTime="2026-09-11 17:46:31.321322634 +0000 UTC m=+84.247274417"
Sep 11 17:46:31.321723 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:31.321707    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-q546l"]
Sep 11 17:46:31.324538 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:31.324516    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"]
Sep 11 17:46:31.337678 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:46:31.337647    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9aed4f0_ec68_45f1_afd8_276cf0d4a2cd.slice/crio-383ba32f56b5393bd4249541bdbaf2a2dacc0d31a8de210ea32f1616c7a04bcf WatchSource:0}: Error finding container 383ba32f56b5393bd4249541bdbaf2a2dacc0d31a8de210ea32f1616c7a04bcf: Status 404 returned error can't find the container with id 383ba32f56b5393bd4249541bdbaf2a2dacc0d31a8de210ea32f1616c7a04bcf
Sep 11 17:46:31.918037 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:31.917993    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc" event={"ID":"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd","Type":"ContainerStarted","Data":"da6ce543b21ae2918fd2e9ec4993fe9aac4b18e1fd25cc772b773865ea0f34c3"}
Sep 11 17:46:31.918448 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:31.918058    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc" event={"ID":"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd","Type":"ContainerStarted","Data":"383ba32f56b5393bd4249541bdbaf2a2dacc0d31a8de210ea32f1616c7a04bcf"}
Sep 11 17:46:31.918448 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:31.918095    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:46:31.919190 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:31.919171    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-q546l" event={"ID":"042c3351-c263-4833-a34e-a2bc9599ee2f","Type":"ContainerStarted","Data":"7ae6bd25fbd838e55f5c4ba6d79d6fc71614c098d27ce38511bf2a6e47cb7212"}
Sep 11 17:46:31.956734 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:31.956686    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc" podStartSLOduration=16.956671482 podStartE2EDuration="16.956671482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:46:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:46:31.955504266 +0000 UTC m=+84.881456036" watchObservedRunningTime="2026-09-11 17:46:31.956671482 +0000 UTC m=+84.882623227"
Sep 11 17:46:33.929443 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:33.929405    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-q546l" event={"ID":"042c3351-c263-4833-a34e-a2bc9599ee2f","Type":"ContainerStarted","Data":"ea57068eddb9e1173902d5d717976a494b1220b726406d7d143e75c0933edfc3"}
Sep 11 17:46:33.929850 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:33.929457    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-q546l" event={"ID":"042c3351-c263-4833-a34e-a2bc9599ee2f","Type":"ContainerStarted","Data":"e78d9b61a9d445a205cfb053ed3302538492059c64085d22585ad3321f0bcbdf"}
Sep 11 17:46:33.974065 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:33.974014    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-q546l" podStartSLOduration=17.291489215 podStartE2EDuration="18.973996557s" totalImagesPullingTime="1.682507342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:46:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:46:33.973904898 +0000 UTC m=+86.899856655" watchObservedRunningTime="2026-09-11 17:46:33.973996557 +0000 UTC m=+86.899948303"
Sep 11 17:46:36.195116 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:36.195065    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/084f613d-75ac-40dd-bc1f-e883a576851b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:36.195501 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:36.195151    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/084f613d-75ac-40dd-bc1f-e883a576851b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:36.195648 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:36.195631    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/084f613d-75ac-40dd-bc1f-e883a576851b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:36.197308 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:36.197285    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/084f613d-75ac-40dd-bc1f-e883a576851b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5565\" (UID: \"084f613d-75ac-40dd-bc1f-e883a576851b\") " pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:36.335840 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:36.335790    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z5565"
Sep 11 17:46:36.528455 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:36.528429    2579 scope.go:117] "RemoveContainer" containerID="e9e2a494ccfdad0c2810595aecce2118603287e21c0a94b5497f72d850024b96"
Sep 11 17:46:36.613372 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:36.613343    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z5565"]
Sep 11 17:46:36.615738 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:46:36.615712    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod084f613d_75ac_40dd_bc1f_e883a576851b.slice/crio-7fc66bf35b9871060c07ed75ad8ca2a16c64b63354bb13e880d86456bd821bea WatchSource:0}: Error finding container 7fc66bf35b9871060c07ed75ad8ca2a16c64b63354bb13e880d86456bd821bea: Status 404 returned error can't find the container with id 7fc66bf35b9871060c07ed75ad8ca2a16c64b63354bb13e880d86456bd821bea
Sep 11 17:46:36.939981 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:36.939918    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-bbhjk_46c0eccf-9fc2-4fbf-ae39-3b1cf093b352/console-operator/1.log"
Sep 11 17:46:36.940126 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:36.940005    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-bbhjk" event={"ID":"46c0eccf-9fc2-4fbf-ae39-3b1cf093b352","Type":"ContainerStarted","Data":"2a86dc69aa03420e19b981f33f27317e7e913981bb6e9fee73b144e5e92799ce"}
Sep 11 17:46:36.940377 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:36.940361    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-bbhjk"
Sep 11 17:46:36.941748 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:36.941720    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z5565" event={"ID":"084f613d-75ac-40dd-bc1f-e883a576851b","Type":"ContainerStarted","Data":"bd358e7432e2897d60a52e439c20efea19a7ed80ffbcc8d3e6a58310b9c28b7e"}
Sep 11 17:46:36.941883 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:36.941794    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z5565" event={"ID":"084f613d-75ac-40dd-bc1f-e883a576851b","Type":"ContainerStarted","Data":"7fc66bf35b9871060c07ed75ad8ca2a16c64b63354bb13e880d86456bd821bea"}
Sep 11 17:46:36.945194 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:36.945142    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-bbhjk"
Sep 11 17:46:36.984977 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:36.984915    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-bbhjk" podStartSLOduration=18.521957905 podStartE2EDuration="21.98489281s" totalImagesPullingTime="3.462934905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:46:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:46:36.983622136 +0000 UTC m=+89.909573882" watchObservedRunningTime="2026-09-11 17:46:36.98489281 +0000 UTC m=+89.910844558"
Sep 11 17:46:37.947313 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:37.947275    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z5565" event={"ID":"084f613d-75ac-40dd-bc1f-e883a576851b","Type":"ContainerStarted","Data":"81695e5a6637d9d5eb9c03edf930342be98f1b5f1e4a79548fad93f52b756868"}
Sep 11 17:46:41.963174 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:41.963138    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z5565" event={"ID":"084f613d-75ac-40dd-bc1f-e883a576851b","Type":"ContainerStarted","Data":"b2c227a8795028d2ddb1310465b5866fc76a68df59181b3ee1e1c519f0fbf01b"}
Sep 11 17:46:41.995221 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:41.995167    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z5565" podStartSLOduration=17.537687653 podStartE2EDuration="21.995150194s" totalImagesPullingTime="4.457462541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:46:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:46:41.993277318 +0000 UTC m=+94.919229063" watchObservedRunningTime="2026-09-11 17:46:41.995150194 +0000 UTC m=+94.921101939"
Sep 11 17:46:45.870609 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:45.870567    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls\") pod \"dns-default-xnrgn\" (UID: \"51199ad2-1d9f-4951-af87-21d70591fdf7\") " pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:46:45.872931 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:45.872905    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51199ad2-1d9f-4951-af87-21d70591fdf7-metrics-tls\") pod \"dns-default-xnrgn\" (UID: \"51199ad2-1d9f-4951-af87-21d70591fdf7\") " pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:46:46.177291 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:46.177212    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tc7ww\""
Sep 11 17:46:46.180310 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:46.180282    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:46:46.486957 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:46.486932    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xnrgn"]
Sep 11 17:46:46.488390 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:46:46.488362    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51199ad2_1d9f_4951_af87_21d70591fdf7.slice/crio-9591de29dc6501ae699112bafb984ad20530f9625c8e445059b52eb02c77da13 WatchSource:0}: Error finding container 9591de29dc6501ae699112bafb984ad20530f9625c8e445059b52eb02c77da13: Status 404 returned error can't find the container with id 9591de29dc6501ae699112bafb984ad20530f9625c8e445059b52eb02c77da13
Sep 11 17:46:46.677544 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:46.677503    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/971cc6c8-731b-486b-8f31-bb4d99ab2364-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-4j9td\" (UID: \"971cc6c8-731b-486b-8f31-bb4d99ab2364\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td"
Sep 11 17:46:46.679953 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:46.679931    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/971cc6c8-731b-486b-8f31-bb4d99ab2364-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-4j9td\" (UID: \"971cc6c8-731b-486b-8f31-bb4d99ab2364\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td"
Sep 11 17:46:46.692781 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:46.692743    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td"
Sep 11 17:46:46.975880 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:46.975848    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td"]
Sep 11 17:46:46.980307 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:46:46.980282    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod971cc6c8_731b_486b_8f31_bb4d99ab2364.slice/crio-b82b71b9db67bb63be7d83135a2b291ecb3340444a14596a5104895f66fcc9a5 WatchSource:0}: Error finding container b82b71b9db67bb63be7d83135a2b291ecb3340444a14596a5104895f66fcc9a5: Status 404 returned error can't find the container with id b82b71b9db67bb63be7d83135a2b291ecb3340444a14596a5104895f66fcc9a5
Sep 11 17:46:46.980675 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:46.980643    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xnrgn" event={"ID":"51199ad2-1d9f-4951-af87-21d70591fdf7","Type":"ContainerStarted","Data":"9591de29dc6501ae699112bafb984ad20530f9625c8e445059b52eb02c77da13"}
Sep 11 17:46:47.986145 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:47.986097    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td" event={"ID":"971cc6c8-731b-486b-8f31-bb4d99ab2364","Type":"ContainerStarted","Data":"b82b71b9db67bb63be7d83135a2b291ecb3340444a14596a5104895f66fcc9a5"}
Sep 11 17:46:48.992126 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:48.992092    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xnrgn" event={"ID":"51199ad2-1d9f-4951-af87-21d70591fdf7","Type":"ContainerStarted","Data":"439991c9c34e47141ea47afe6c91903211c795386a3df2b33ef7abb7a316f998"}
Sep 11 17:46:48.992529 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:48.992174    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xnrgn" event={"ID":"51199ad2-1d9f-4951-af87-21d70591fdf7","Type":"ContainerStarted","Data":"eea7519271376e336455612357974a9c5fea437200699f0c29c23eb73fb50a0c"}
Sep 11 17:46:48.992529 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:48.992205    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:46:48.993721 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:48.993692    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td" event={"ID":"971cc6c8-731b-486b-8f31-bb4d99ab2364","Type":"ContainerStarted","Data":"a3840f828d436b2a283cfae1b152f6cab640929dbcc8d9ac7895c0931c95e345"}
Sep 11 17:46:49.034631 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:49.034534    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xnrgn" podStartSLOduration=65.775654585 podStartE2EDuration="1m8.034518071s" totalImagesPullingTime="2.258863486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:46:49.034244543 +0000 UTC m=+101.960196289" watchObservedRunningTime="2026-09-11 17:46:49.034518071 +0000 UTC m=+101.960469818"
Sep 11 17:46:49.141223 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:49.141175    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-4j9td" podStartSLOduration=33.373658794 podStartE2EDuration="35.141159399s" totalImagesPullingTime="1.767500605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:46:49.14098804 +0000 UTC m=+102.066939786" watchObservedRunningTime="2026-09-11 17:46:49.141159399 +0000 UTC m=+102.067111144"
Sep 11 17:46:50.879128 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:50.879089    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hjngm"
Sep 11 17:46:51.001986 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.001957    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-j7tlx"]
Sep 11 17:46:51.036452 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.036422    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-j7tlx"]
Sep 11 17:46:51.036625 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.036518    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-j7tlx"
Sep 11 17:46:51.037813 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.037753    2579 patch_prober.go:28] interesting pod/image-registry-5b6f54f7f7-ctmbc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 11 17:46:51.037948 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.037836    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc" podUID="e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 17:46:51.039652 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.039628    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-dx868\""
Sep 11 17:46:51.042116 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.042095    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 11 17:46:51.076187 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.076157    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"]
Sep 11 17:46:51.080426 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.080399    2579 patch_prober.go:28] interesting pod/image-registry-5b6f54f7f7-ctmbc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 11 17:46:51.080553 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.080443    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc" podUID="e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 17:46:51.113258 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.113219    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/40853393-edf0-4187-af44-00052c907622-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-j7tlx\" (UID: \"40853393-edf0-4187-af44-00052c907622\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-j7tlx"
Sep 11 17:46:51.147120 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.147045    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-746b74566c-6h2hj"]
Sep 11 17:46:51.167118 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.167088    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:46:51.175749 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.175722    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 17:46:51.176008 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.175988    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 17:46:51.176117 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.176025    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 17:46:51.176117 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.176051    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 17:46:51.176117 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.176030    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mm5sn\""
Sep 11 17:46:51.176291 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.176030    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 17:46:51.176291 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.176154    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 17:46:51.180444 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.180423    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 17:46:51.181482 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.181461    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-746b74566c-6h2hj"]
Sep 11 17:46:51.213924 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.213895    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/40853393-edf0-4187-af44-00052c907622-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-j7tlx\" (UID: \"40853393-edf0-4187-af44-00052c907622\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-j7tlx"
Sep 11 17:46:51.216155 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.216128    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/40853393-edf0-4187-af44-00052c907622-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-j7tlx\" (UID: \"40853393-edf0-4187-af44-00052c907622\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-j7tlx"
Sep 11 17:46:51.315286 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.315252    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/124c974d-f841-4579-a50b-512b832ea0ba-console-config\") pod \"console-746b74566c-6h2hj\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") " pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:46:51.315450 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.315298    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnn85\" (UniqueName: \"kubernetes.io/projected/124c974d-f841-4579-a50b-512b832ea0ba-kube-api-access-pnn85\") pod \"console-746b74566c-6h2hj\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") " pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:46:51.315450 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.315366    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/124c974d-f841-4579-a50b-512b832ea0ba-console-serving-cert\") pod \"console-746b74566c-6h2hj\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") " pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:46:51.315450 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.315405    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/124c974d-f841-4579-a50b-512b832ea0ba-service-ca\") pod \"console-746b74566c-6h2hj\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") " pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:46:51.315450 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.315431    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/124c974d-f841-4579-a50b-512b832ea0ba-console-oauth-config\") pod \"console-746b74566c-6h2hj\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") " pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:46:51.315596 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.315459    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/124c974d-f841-4579-a50b-512b832ea0ba-oauth-serving-cert\") pod \"console-746b74566c-6h2hj\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") " pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:46:51.347414 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.347383    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-j7tlx"
Sep 11 17:46:51.416280 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.416247    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/124c974d-f841-4579-a50b-512b832ea0ba-oauth-serving-cert\") pod \"console-746b74566c-6h2hj\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") " pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:46:51.416414 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.416325    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/124c974d-f841-4579-a50b-512b832ea0ba-console-config\") pod \"console-746b74566c-6h2hj\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") " pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:46:51.416414 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.416359    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnn85\" (UniqueName: \"kubernetes.io/projected/124c974d-f841-4579-a50b-512b832ea0ba-kube-api-access-pnn85\") pod \"console-746b74566c-6h2hj\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") " pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:46:51.416414 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.416394    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/124c974d-f841-4579-a50b-512b832ea0ba-console-serving-cert\") pod \"console-746b74566c-6h2hj\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") " pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:46:51.416595 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.416424    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/124c974d-f841-4579-a50b-512b832ea0ba-service-ca\") pod \"console-746b74566c-6h2hj\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") " pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:46:51.416595 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.416458    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/124c974d-f841-4579-a50b-512b832ea0ba-console-oauth-config\") pod \"console-746b74566c-6h2hj\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") " pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:46:51.417564 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.417518    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/124c974d-f841-4579-a50b-512b832ea0ba-service-ca\") pod \"console-746b74566c-6h2hj\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") " pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:46:51.417564 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.417535    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/124c974d-f841-4579-a50b-512b832ea0ba-oauth-serving-cert\") pod \"console-746b74566c-6h2hj\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") " pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:46:51.417790 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.417589    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/124c974d-f841-4579-a50b-512b832ea0ba-console-config\") pod \"console-746b74566c-6h2hj\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") " pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:46:51.419804 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.419778    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/124c974d-f841-4579-a50b-512b832ea0ba-console-oauth-config\") pod \"console-746b74566c-6h2hj\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") " pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:46:51.420137 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.419896    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/124c974d-f841-4579-a50b-512b832ea0ba-console-serving-cert\") pod \"console-746b74566c-6h2hj\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") " pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:46:51.434240 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.434216    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnn85\" (UniqueName: \"kubernetes.io/projected/124c974d-f841-4579-a50b-512b832ea0ba-kube-api-access-pnn85\") pod \"console-746b74566c-6h2hj\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") " pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:46:51.475748 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.475715    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:46:51.640095 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.640061    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-j7tlx"]
Sep 11 17:46:51.645015 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:46:51.644986    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40853393_edf0_4187_af44_00052c907622.slice/crio-343018db759cd2b3f6be255eae9213a0de72280dfd8176637aa42acd9948bba0 WatchSource:0}: Error finding container 343018db759cd2b3f6be255eae9213a0de72280dfd8176637aa42acd9948bba0: Status 404 returned error can't find the container with id 343018db759cd2b3f6be255eae9213a0de72280dfd8176637aa42acd9948bba0
Sep 11 17:46:51.788664 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:51.788628    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-746b74566c-6h2hj"]
Sep 11 17:46:51.792729 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:46:51.792689    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod124c974d_f841_4579_a50b_512b832ea0ba.slice/crio-093901e9d63d8b45f701cf29849f69c100e45d2356eb157132edd70835d5a671 WatchSource:0}: Error finding container 093901e9d63d8b45f701cf29849f69c100e45d2356eb157132edd70835d5a671: Status 404 returned error can't find the container with id 093901e9d63d8b45f701cf29849f69c100e45d2356eb157132edd70835d5a671
Sep 11 17:46:52.004268 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:52.004229    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746b74566c-6h2hj" event={"ID":"124c974d-f841-4579-a50b-512b832ea0ba","Type":"ContainerStarted","Data":"093901e9d63d8b45f701cf29849f69c100e45d2356eb157132edd70835d5a671"}
Sep 11 17:46:52.005439 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:52.005407    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-j7tlx" event={"ID":"40853393-edf0-4187-af44-00052c907622","Type":"ContainerStarted","Data":"343018db759cd2b3f6be255eae9213a0de72280dfd8176637aa42acd9948bba0"}
Sep 11 17:46:54.015123 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:54.015084    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-j7tlx" event={"ID":"40853393-edf0-4187-af44-00052c907622","Type":"ContainerStarted","Data":"489ef1b6f80e2a88dc1a06803194c9849cc4a0d287d5b0cf5f38e5e5ff5527a5"}
Sep 11 17:46:54.015656 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:54.015300    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-j7tlx"
Sep 11 17:46:54.021598 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:54.021568    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-j7tlx"
Sep 11 17:46:54.043606 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:54.043561    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-j7tlx" podStartSLOduration=2.192857287 podStartE2EDuration="4.043544601s" totalImagesPullingTime="1.850687314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:46:54.043133666 +0000 UTC m=+106.969085441" watchObservedRunningTime="2026-09-11 17:46:54.043544601 +0000 UTC m=+106.969496346"
Sep 11 17:46:55.019942 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:55.019909    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746b74566c-6h2hj" event={"ID":"124c974d-f841-4579-a50b-512b832ea0ba","Type":"ContainerStarted","Data":"fafb5cda9f243331ca60475f67dc7dc55ddeeaa5bdd016d76540e56b1df7af23"}
Sep 11 17:46:55.050351 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:55.050302    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-746b74566c-6h2hj" podStartSLOduration=1.111474912 podStartE2EDuration="4.050285168s" totalImagesPullingTime="2.938810256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:46:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:46:55.050081089 +0000 UTC m=+107.976032840" watchObservedRunningTime="2026-09-11 17:46:55.050285168 +0000 UTC m=+107.976236927"
Sep 11 17:46:58.999623 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:46:58.999591    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xnrgn"
Sep 11 17:47:01.081526 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.081491    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:47:01.407251 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.407179    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq"]
Sep 11 17:47:01.409512 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.409496    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq"
Sep 11 17:47:01.412020 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.411991    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 11 17:47:01.412149 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.411998    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 11 17:47:01.412149 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.412095    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-qcgvj\""
Sep 11 17:47:01.412484 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.412469    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 17:47:01.432542 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.432518    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq"]
Sep 11 17:47:01.476346 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.476312    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:47:01.476481 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.476380    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:47:01.481060 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.481036    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:47:01.523943 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.523872    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"]
Sep 11 17:47:01.526540 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.526518    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"
Sep 11 17:47:01.529251 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.529228    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 11 17:47:01.529598 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.529574    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 11 17:47:01.529698 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.529679    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-cjgrk\""
Sep 11 17:47:01.530546 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.530532    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 11 17:47:01.563718 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.563672    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-psdvb"]
Sep 11 17:47:01.566130 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.566113    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.569097 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.569070    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 17:47:01.569565 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.569544    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 17:47:01.570242 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.570216    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 17:47:01.570510 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.570494    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"]
Sep 11 17:47:01.570981 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.570961    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hxrkn\""
Sep 11 17:47:01.594184 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.594161    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecd08429-25a9-4c91-aea0-d3ad18d6a5bc-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-plwfq\" (UID: \"ecd08429-25a9-4c91-aea0-d3ad18d6a5bc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq"
Sep 11 17:47:01.594325 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.594217    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ecd08429-25a9-4c91-aea0-d3ad18d6a5bc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-plwfq\" (UID: \"ecd08429-25a9-4c91-aea0-d3ad18d6a5bc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq"
Sep 11 17:47:01.594325 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.594289    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfbrd\" (UniqueName: \"kubernetes.io/projected/ecd08429-25a9-4c91-aea0-d3ad18d6a5bc-kube-api-access-pfbrd\") pod \"openshift-state-metrics-67dcf8c979-plwfq\" (UID: \"ecd08429-25a9-4c91-aea0-d3ad18d6a5bc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq"
Sep 11 17:47:01.594438 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.594402    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ecd08429-25a9-4c91-aea0-d3ad18d6a5bc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-plwfq\" (UID: \"ecd08429-25a9-4c91-aea0-d3ad18d6a5bc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq"
Sep 11 17:47:01.695613 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.695536    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcv6k\" (UniqueName: \"kubernetes.io/projected/6dfb1f42-ef31-4c26-a471-e32e2085d2e6-kube-api-access-mcv6k\") pod \"kube-state-metrics-59fbdd77d-pbcx9\" (UID: \"6dfb1f42-ef31-4c26-a471-e32e2085d2e6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"
Sep 11 17:47:01.695613 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.695567    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dccb0c59-a0b5-46d6-a397-de521c8a3c24-sys\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.695613 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.695587    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dccb0c59-a0b5-46d6-a397-de521c8a3c24-node-exporter-tls\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.695876 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.695615    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ecd08429-25a9-4c91-aea0-d3ad18d6a5bc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-plwfq\" (UID: \"ecd08429-25a9-4c91-aea0-d3ad18d6a5bc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq"
Sep 11 17:47:01.695876 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.695634    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfbrd\" (UniqueName: \"kubernetes.io/projected/ecd08429-25a9-4c91-aea0-d3ad18d6a5bc-kube-api-access-pfbrd\") pod \"openshift-state-metrics-67dcf8c979-plwfq\" (UID: \"ecd08429-25a9-4c91-aea0-d3ad18d6a5bc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq"
Sep 11 17:47:01.695876 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.695686    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dccb0c59-a0b5-46d6-a397-de521c8a3c24-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.695876 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.695719    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxw7t\" (UniqueName: \"kubernetes.io/projected/dccb0c59-a0b5-46d6-a397-de521c8a3c24-kube-api-access-pxw7t\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.695876 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.695744    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dccb0c59-a0b5-46d6-a397-de521c8a3c24-node-exporter-accelerators-collector-config\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.695876 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.695795    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6dfb1f42-ef31-4c26-a471-e32e2085d2e6-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-pbcx9\" (UID: \"6dfb1f42-ef31-4c26-a471-e32e2085d2e6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"
Sep 11 17:47:01.695876 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.695823    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dfb1f42-ef31-4c26-a471-e32e2085d2e6-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-pbcx9\" (UID: \"6dfb1f42-ef31-4c26-a471-e32e2085d2e6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"
Sep 11 17:47:01.695876 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.695847    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dccb0c59-a0b5-46d6-a397-de521c8a3c24-node-exporter-textfile\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.695876 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.695870    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dccb0c59-a0b5-46d6-a397-de521c8a3c24-node-exporter-wtmp\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.696206 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.695936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ecd08429-25a9-4c91-aea0-d3ad18d6a5bc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-plwfq\" (UID: \"ecd08429-25a9-4c91-aea0-d3ad18d6a5bc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq"
Sep 11 17:47:01.696206 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.695958    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6dfb1f42-ef31-4c26-a471-e32e2085d2e6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-pbcx9\" (UID: \"6dfb1f42-ef31-4c26-a471-e32e2085d2e6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"
Sep 11 17:47:01.696206 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.695982    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dccb0c59-a0b5-46d6-a397-de521c8a3c24-metrics-client-ca\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.696206 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.696007    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dccb0c59-a0b5-46d6-a397-de521c8a3c24-root\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.696206 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.696040    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dfb1f42-ef31-4c26-a471-e32e2085d2e6-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-pbcx9\" (UID: \"6dfb1f42-ef31-4c26-a471-e32e2085d2e6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"
Sep 11 17:47:01.696206 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.696061    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6dfb1f42-ef31-4c26-a471-e32e2085d2e6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-pbcx9\" (UID: \"6dfb1f42-ef31-4c26-a471-e32e2085d2e6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"
Sep 11 17:47:01.696206 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.696096    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecd08429-25a9-4c91-aea0-d3ad18d6a5bc-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-plwfq\" (UID: \"ecd08429-25a9-4c91-aea0-d3ad18d6a5bc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq"
Sep 11 17:47:01.696772 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.696730    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecd08429-25a9-4c91-aea0-d3ad18d6a5bc-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-plwfq\" (UID: \"ecd08429-25a9-4c91-aea0-d3ad18d6a5bc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq"
Sep 11 17:47:01.698287 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.698259    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ecd08429-25a9-4c91-aea0-d3ad18d6a5bc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-plwfq\" (UID: \"ecd08429-25a9-4c91-aea0-d3ad18d6a5bc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq"
Sep 11 17:47:01.698384 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.698302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ecd08429-25a9-4c91-aea0-d3ad18d6a5bc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-plwfq\" (UID: \"ecd08429-25a9-4c91-aea0-d3ad18d6a5bc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq"
Sep 11 17:47:01.707288 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.707270    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfbrd\" (UniqueName: \"kubernetes.io/projected/ecd08429-25a9-4c91-aea0-d3ad18d6a5bc-kube-api-access-pfbrd\") pod \"openshift-state-metrics-67dcf8c979-plwfq\" (UID: \"ecd08429-25a9-4c91-aea0-d3ad18d6a5bc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq"
Sep 11 17:47:01.719125 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.719106    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq"
Sep 11 17:47:01.797365 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.797336    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcv6k\" (UniqueName: \"kubernetes.io/projected/6dfb1f42-ef31-4c26-a471-e32e2085d2e6-kube-api-access-mcv6k\") pod \"kube-state-metrics-59fbdd77d-pbcx9\" (UID: \"6dfb1f42-ef31-4c26-a471-e32e2085d2e6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"
Sep 11 17:47:01.797511 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.797371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dccb0c59-a0b5-46d6-a397-de521c8a3c24-sys\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.797511 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.797395    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dccb0c59-a0b5-46d6-a397-de521c8a3c24-node-exporter-tls\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.797511 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.797460    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dccb0c59-a0b5-46d6-a397-de521c8a3c24-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.797511 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.797487    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxw7t\" (UniqueName: \"kubernetes.io/projected/dccb0c59-a0b5-46d6-a397-de521c8a3c24-kube-api-access-pxw7t\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.797511 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.797485    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dccb0c59-a0b5-46d6-a397-de521c8a3c24-sys\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.797826 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.797515    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dccb0c59-a0b5-46d6-a397-de521c8a3c24-node-exporter-accelerators-collector-config\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.797826 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.797550    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6dfb1f42-ef31-4c26-a471-e32e2085d2e6-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-pbcx9\" (UID: \"6dfb1f42-ef31-4c26-a471-e32e2085d2e6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"
Sep 11 17:47:01.797826 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.797586    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dfb1f42-ef31-4c26-a471-e32e2085d2e6-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-pbcx9\" (UID: \"6dfb1f42-ef31-4c26-a471-e32e2085d2e6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"
Sep 11 17:47:01.797826 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.797610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dccb0c59-a0b5-46d6-a397-de521c8a3c24-node-exporter-textfile\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.797826 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.797630    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dccb0c59-a0b5-46d6-a397-de521c8a3c24-node-exporter-wtmp\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.797826 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.797665    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6dfb1f42-ef31-4c26-a471-e32e2085d2e6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-pbcx9\" (UID: \"6dfb1f42-ef31-4c26-a471-e32e2085d2e6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"
Sep 11 17:47:01.797826 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.797700    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dccb0c59-a0b5-46d6-a397-de521c8a3c24-metrics-client-ca\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.797826 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:47:01.797714    2579 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 11 17:47:01.797826 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.797728    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dccb0c59-a0b5-46d6-a397-de521c8a3c24-root\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.797826 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.797775    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dfb1f42-ef31-4c26-a471-e32e2085d2e6-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-pbcx9\" (UID: \"6dfb1f42-ef31-4c26-a471-e32e2085d2e6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"
Sep 11 17:47:01.797826 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:47:01.797809    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dfb1f42-ef31-4c26-a471-e32e2085d2e6-kube-state-metrics-tls podName:6dfb1f42-ef31-4c26-a471-e32e2085d2e6 nodeName:}" failed. No retries permitted until 2026-09-11 17:47:02.297788154 +0000 UTC m=+115.223739900 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6dfb1f42-ef31-4c26-a471-e32e2085d2e6-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-pbcx9" (UID: "6dfb1f42-ef31-4c26-a471-e32e2085d2e6") : secret "kube-state-metrics-tls" not found
Sep 11 17:47:01.798369 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.797849    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6dfb1f42-ef31-4c26-a471-e32e2085d2e6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-pbcx9\" (UID: \"6dfb1f42-ef31-4c26-a471-e32e2085d2e6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"
Sep 11 17:47:01.798369 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.798048    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6dfb1f42-ef31-4c26-a471-e32e2085d2e6-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-pbcx9\" (UID: \"6dfb1f42-ef31-4c26-a471-e32e2085d2e6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"
Sep 11 17:47:01.798369 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.798228    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dccb0c59-a0b5-46d6-a397-de521c8a3c24-root\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.798369 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.798355    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dccb0c59-a0b5-46d6-a397-de521c8a3c24-node-exporter-wtmp\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.798565 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.798516    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dccb0c59-a0b5-46d6-a397-de521c8a3c24-node-exporter-accelerators-collector-config\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.798620 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.798567    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dccb0c59-a0b5-46d6-a397-de521c8a3c24-metrics-client-ca\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.798620 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.798592    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dccb0c59-a0b5-46d6-a397-de521c8a3c24-node-exporter-textfile\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.799132 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.799106    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6dfb1f42-ef31-4c26-a471-e32e2085d2e6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-pbcx9\" (UID: \"6dfb1f42-ef31-4c26-a471-e32e2085d2e6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"
Sep 11 17:47:01.799347 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.799329    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dfb1f42-ef31-4c26-a471-e32e2085d2e6-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-pbcx9\" (UID: \"6dfb1f42-ef31-4c26-a471-e32e2085d2e6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"
Sep 11 17:47:01.800119 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.800093    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dccb0c59-a0b5-46d6-a397-de521c8a3c24-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.800681 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.800661    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dccb0c59-a0b5-46d6-a397-de521c8a3c24-node-exporter-tls\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.800780 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.800728    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6dfb1f42-ef31-4c26-a471-e32e2085d2e6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-pbcx9\" (UID: \"6dfb1f42-ef31-4c26-a471-e32e2085d2e6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"
Sep 11 17:47:01.806954 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.806926    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcv6k\" (UniqueName: \"kubernetes.io/projected/6dfb1f42-ef31-4c26-a471-e32e2085d2e6-kube-api-access-mcv6k\") pod \"kube-state-metrics-59fbdd77d-pbcx9\" (UID: \"6dfb1f42-ef31-4c26-a471-e32e2085d2e6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"
Sep 11 17:47:01.807690 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.807667    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxw7t\" (UniqueName: \"kubernetes.io/projected/dccb0c59-a0b5-46d6-a397-de521c8a3c24-kube-api-access-pxw7t\") pod \"node-exporter-psdvb\" (UID: \"dccb0c59-a0b5-46d6-a397-de521c8a3c24\") " pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.875675 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.875642    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-psdvb"
Sep 11 17:47:01.886042 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:47:01.886018    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddccb0c59_a0b5_46d6_a397_de521c8a3c24.slice/crio-9710a2e9e6ecc692ff39877c454def9bdceaeb8310bdf9e1d8b16f81acaac6b3 WatchSource:0}: Error finding container 9710a2e9e6ecc692ff39877c454def9bdceaeb8310bdf9e1d8b16f81acaac6b3: Status 404 returned error can't find the container with id 9710a2e9e6ecc692ff39877c454def9bdceaeb8310bdf9e1d8b16f81acaac6b3
Sep 11 17:47:01.989122 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:01.989098    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq"]
Sep 11 17:47:01.993026 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:47:01.992585    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecd08429_25a9_4c91_aea0_d3ad18d6a5bc.slice/crio-f3c09b49769008ccea3d7acda9adc03aad3559483e02af7a78406060c7e268c2 WatchSource:0}: Error finding container f3c09b49769008ccea3d7acda9adc03aad3559483e02af7a78406060c7e268c2: Status 404 returned error can't find the container with id f3c09b49769008ccea3d7acda9adc03aad3559483e02af7a78406060c7e268c2
Sep 11 17:47:02.045065 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:02.045033    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-psdvb" event={"ID":"dccb0c59-a0b5-46d6-a397-de521c8a3c24","Type":"ContainerStarted","Data":"9710a2e9e6ecc692ff39877c454def9bdceaeb8310bdf9e1d8b16f81acaac6b3"}
Sep 11 17:47:02.046377 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:02.046345    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq" event={"ID":"ecd08429-25a9-4c91-aea0-d3ad18d6a5bc","Type":"ContainerStarted","Data":"f3c09b49769008ccea3d7acda9adc03aad3559483e02af7a78406060c7e268c2"}
Sep 11 17:47:02.050930 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:02.050908    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:47:02.302505 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:02.302428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dfb1f42-ef31-4c26-a471-e32e2085d2e6-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-pbcx9\" (UID: \"6dfb1f42-ef31-4c26-a471-e32e2085d2e6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"
Sep 11 17:47:02.304723 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:02.304699    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dfb1f42-ef31-4c26-a471-e32e2085d2e6-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-pbcx9\" (UID: \"6dfb1f42-ef31-4c26-a471-e32e2085d2e6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"
Sep 11 17:47:02.435574 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:02.435538    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"
Sep 11 17:47:02.719294 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:02.719268    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9"]
Sep 11 17:47:02.866019 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:47:02.865987    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dfb1f42_ef31_4c26_a471_e32e2085d2e6.slice/crio-e849fcc6cad3252d553ebe6ab4e1cd8dddb8e427b5ee9279a3d3e82633198092 WatchSource:0}: Error finding container e849fcc6cad3252d553ebe6ab4e1cd8dddb8e427b5ee9279a3d3e82633198092: Status 404 returned error can't find the container with id e849fcc6cad3252d553ebe6ab4e1cd8dddb8e427b5ee9279a3d3e82633198092
Sep 11 17:47:03.052068 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:03.052030    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9" event={"ID":"6dfb1f42-ef31-4c26-a471-e32e2085d2e6","Type":"ContainerStarted","Data":"e849fcc6cad3252d553ebe6ab4e1cd8dddb8e427b5ee9279a3d3e82633198092"}
Sep 11 17:47:03.054317 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:03.054279    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq" event={"ID":"ecd08429-25a9-4c91-aea0-d3ad18d6a5bc","Type":"ContainerStarted","Data":"6f45364aadc3efc87872d27a0f9ed5c0f58b71a1aa0a29c01eccd26c08696f42"}
Sep 11 17:47:03.054457 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:03.054351    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq" event={"ID":"ecd08429-25a9-4c91-aea0-d3ad18d6a5bc","Type":"ContainerStarted","Data":"da8c86e6dd85c7f58f2b74e653b247d592605b58b10b64b54bf305f4200df6f8"}
Sep 11 17:47:04.060852 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.060800    2579 generic.go:356] "Generic (PLEG): container finished" podID="dccb0c59-a0b5-46d6-a397-de521c8a3c24" containerID="66621f28b9c85b13fd05b6df799082a0dd0bf937533910d50839de1108acb9e2" exitCode=0
Sep 11 17:47:04.061297 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.060854    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-psdvb" event={"ID":"dccb0c59-a0b5-46d6-a397-de521c8a3c24","Type":"ContainerDied","Data":"66621f28b9c85b13fd05b6df799082a0dd0bf937533910d50839de1108acb9e2"}
Sep 11 17:47:04.063714 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.063683    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq" event={"ID":"ecd08429-25a9-4c91-aea0-d3ad18d6a5bc","Type":"ContainerStarted","Data":"36de785edd1ba51d9b2c93a4f4c356207abc6fc7d71b53629de9bcf38ee1313c"}
Sep 11 17:47:04.121309 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.121270    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-plwfq" podStartSLOduration=2.142041357 podStartE2EDuration="3.121254792s" totalImagesPullingTime="979.213435ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:47:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:47:04.121185574 +0000 UTC m=+117.047137330" watchObservedRunningTime="2026-09-11 17:47:04.121254792 +0000 UTC m=+117.047206537"
Sep 11 17:47:04.393257 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.393177    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"]
Sep 11 17:47:04.396636 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.396617    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.399807 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.399785    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 11 17:47:04.399986 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.399966    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 11 17:47:04.400346 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.400318    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 11 17:47:04.400451 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.400386    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hvzhr\""
Sep 11 17:47:04.400451 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.400410    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 11 17:47:04.400555 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.400522    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 11 17:47:04.401081 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.401061    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-e8bvmjul4fhnj\""
Sep 11 17:47:04.421711 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.421681    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.421844 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.421724    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-metrics-client-ca\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.421844 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.421751    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjtnj\" (UniqueName: \"kubernetes.io/projected/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-kube-api-access-kjtnj\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.421844 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.421814    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.421844 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.421842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-secret-thanos-querier-tls\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.422080 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.421883    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-secret-grpc-tls\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.422080 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.421957    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.422080 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.421984    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.430748 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.430715    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"]
Sep 11 17:47:04.522491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.522461    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.522646 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.522498    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-metrics-client-ca\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.522646 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.522519    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjtnj\" (UniqueName: \"kubernetes.io/projected/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-kube-api-access-kjtnj\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.522646 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.522542    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.522646 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.522561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-secret-thanos-querier-tls\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.523000 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.522919    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-secret-grpc-tls\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.523111 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.523031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.523111 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.523061    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.523593 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.523317    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-metrics-client-ca\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.525414 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.525393    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.525653 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.525628    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.525816 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.525683    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.525884 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.525827    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-secret-thanos-querier-tls\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.525950 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.525929    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.525998 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.525974    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-secret-grpc-tls\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.531925 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.531907    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjtnj\" (UniqueName: \"kubernetes.io/projected/cfc0cf9d-1bc8-4366-826f-1982c1ad23e0-kube-api-access-kjtnj\") pod \"thanos-querier-78546f8bf8-ppvn5\" (UID: \"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0\") " pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.706676 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.706603    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:04.743873 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:04.743835    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-746b74566c-6h2hj"]
Sep 11 17:47:05.011053 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:05.011022    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"]
Sep 11 17:47:05.014032 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:47:05.014007    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfc0cf9d_1bc8_4366_826f_1982c1ad23e0.slice/crio-b7d6a5073887f8ea4ee07451f1b81b547b02b97a5efdae65bbb2deeb50422ae9 WatchSource:0}: Error finding container b7d6a5073887f8ea4ee07451f1b81b547b02b97a5efdae65bbb2deeb50422ae9: Status 404 returned error can't find the container with id b7d6a5073887f8ea4ee07451f1b81b547b02b97a5efdae65bbb2deeb50422ae9
Sep 11 17:47:05.069215 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:05.069181    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9" event={"ID":"6dfb1f42-ef31-4c26-a471-e32e2085d2e6","Type":"ContainerStarted","Data":"3a9e6d03b1886bc12b02035b3429031798e1074742ee2427c5aecc83fc10df92"}
Sep 11 17:47:05.069698 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:05.069242    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9" event={"ID":"6dfb1f42-ef31-4c26-a471-e32e2085d2e6","Type":"ContainerStarted","Data":"f83bac049e269d4a1e172dc53c287777393afece0dfcb7fcaf9e3d0b305a19de"}
Sep 11 17:47:05.069698 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:05.069263    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9" event={"ID":"6dfb1f42-ef31-4c26-a471-e32e2085d2e6","Type":"ContainerStarted","Data":"ba29c891e1464998483a3d0a00356e25a1062dd97e0c9f9031cc8ebe2b6f1f17"}
Sep 11 17:47:05.071311 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:05.071287    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-psdvb" event={"ID":"dccb0c59-a0b5-46d6-a397-de521c8a3c24","Type":"ContainerStarted","Data":"fdfebd562daef37a2ba59cd1c4a7e32bbdb5ae98fe24404afa8c0792eabcc398"}
Sep 11 17:47:05.071380 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:05.071364    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-psdvb" event={"ID":"dccb0c59-a0b5-46d6-a397-de521c8a3c24","Type":"ContainerStarted","Data":"9d6f80b1f2a75070b08421876fd3c4d8b7861dc1b2f4a1ffd4ee0ce0c5ab1e09"}
Sep 11 17:47:05.072411 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:05.072390    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5" event={"ID":"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0","Type":"ContainerStarted","Data":"b7d6a5073887f8ea4ee07451f1b81b547b02b97a5efdae65bbb2deeb50422ae9"}
Sep 11 17:47:05.102211 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:05.102164    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-pbcx9" podStartSLOduration=2.8557534430000002 podStartE2EDuration="4.102148401s" totalImagesPullingTime="1.246394958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:47:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:47:05.100869238 +0000 UTC m=+118.026820984" watchObservedRunningTime="2026-09-11 17:47:05.102148401 +0000 UTC m=+118.028100146"
Sep 11 17:47:05.126878 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:05.126828    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-psdvb" podStartSLOduration=2.842857758 podStartE2EDuration="4.126809242s" totalImagesPullingTime="1.217021119s" totalInitContainerRuntime="66.930365ms" isStatefulPod=true podCreationTimestamp="2026-09-11 17:47:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:47:05.12637535 +0000 UTC m=+118.052327096" watchObservedRunningTime="2026-09-11 17:47:05.126809242 +0000 UTC m=+118.052760986"
Sep 11 17:47:06.057049 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:06.057016    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-6t4ps"]
Sep 11 17:47:06.060806 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:06.060778    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-6t4ps"
Sep 11 17:47:06.064590 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:06.064567    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 11 17:47:06.064710 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:06.064645    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xjtvp\""
Sep 11 17:47:06.131302 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:06.131267    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-6t4ps"]
Sep 11 17:47:06.134945 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:06.134917    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/51ed57de-bab7-4b62-93ab-e82079b839c3-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-6t4ps\" (UID: \"51ed57de-bab7-4b62-93ab-e82079b839c3\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-6t4ps"
Sep 11 17:47:06.135104 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:06.135071    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snxrl\" (UniqueName: \"kubernetes.io/projected/51ed57de-bab7-4b62-93ab-e82079b839c3-kube-api-access-snxrl\") pod \"monitoring-plugin-5d85778b9d-6t4ps\" (UID: \"51ed57de-bab7-4b62-93ab-e82079b839c3\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-6t4ps"
Sep 11 17:47:06.236401 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:06.236360    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/51ed57de-bab7-4b62-93ab-e82079b839c3-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-6t4ps\" (UID: \"51ed57de-bab7-4b62-93ab-e82079b839c3\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-6t4ps"
Sep 11 17:47:06.236583 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:06.236442    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snxrl\" (UniqueName: \"kubernetes.io/projected/51ed57de-bab7-4b62-93ab-e82079b839c3-kube-api-access-snxrl\") pod \"monitoring-plugin-5d85778b9d-6t4ps\" (UID: \"51ed57de-bab7-4b62-93ab-e82079b839c3\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-6t4ps"
Sep 11 17:47:06.236583 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:47:06.236535    2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 11 17:47:06.236702 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:47:06.236613    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ed57de-bab7-4b62-93ab-e82079b839c3-monitoring-plugin-cert podName:51ed57de-bab7-4b62-93ab-e82079b839c3 nodeName:}" failed. No retries permitted until 2026-09-11 17:47:06.736598412 +0000 UTC m=+119.662550140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/51ed57de-bab7-4b62-93ab-e82079b839c3-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-6t4ps" (UID: "51ed57de-bab7-4b62-93ab-e82079b839c3") : secret "monitoring-plugin-cert" not found
Sep 11 17:47:06.245889 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:06.245860    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snxrl\" (UniqueName: \"kubernetes.io/projected/51ed57de-bab7-4b62-93ab-e82079b839c3-kube-api-access-snxrl\") pod \"monitoring-plugin-5d85778b9d-6t4ps\" (UID: \"51ed57de-bab7-4b62-93ab-e82079b839c3\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-6t4ps"
Sep 11 17:47:06.742047 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:06.742002    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/51ed57de-bab7-4b62-93ab-e82079b839c3-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-6t4ps\" (UID: \"51ed57de-bab7-4b62-93ab-e82079b839c3\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-6t4ps"
Sep 11 17:47:06.742222 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:47:06.742164    2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 11 17:47:06.742356 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:47:06.742243    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ed57de-bab7-4b62-93ab-e82079b839c3-monitoring-plugin-cert podName:51ed57de-bab7-4b62-93ab-e82079b839c3 nodeName:}" failed. No retries permitted until 2026-09-11 17:47:07.74222429 +0000 UTC m=+120.668176036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/51ed57de-bab7-4b62-93ab-e82079b839c3-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-6t4ps" (UID: "51ed57de-bab7-4b62-93ab-e82079b839c3") : secret "monitoring-plugin-cert" not found
Sep 11 17:47:07.086457 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.086420    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5" event={"ID":"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0","Type":"ContainerStarted","Data":"e62b3774493fe15740849daa72cb993b32f00142760d514660aaab36ca4fec81"}
Sep 11 17:47:07.086629 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.086484    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5" event={"ID":"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0","Type":"ContainerStarted","Data":"e308a321105f4d4edc249c5a0091e5a5ff7b4bc1448c81c1e239fc4e867812fa"}
Sep 11 17:47:07.086629 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.086510    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5" event={"ID":"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0","Type":"ContainerStarted","Data":"e18c77b4810ce32b7b342eba472416dcf05fe24270567b835dafe47c40e59c9c"}
Sep 11 17:47:07.704642 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.704607    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 17:47:07.708736 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.708703    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.712979 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.712957    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 11 17:47:07.713280 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.713257    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 11 17:47:07.713361 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.713262    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ktp9l\""
Sep 11 17:47:07.713782 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.713742    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 11 17:47:07.713871 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.713769    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 11 17:47:07.714527 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.714512    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 11 17:47:07.714588 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.714554    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 11 17:47:07.714821 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.714801    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 11 17:47:07.714926 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.714845    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 11 17:47:07.714926 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.714877    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3bnsktqvc5k43\""
Sep 11 17:47:07.714926 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.714896    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 11 17:47:07.715074 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.714845    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 11 17:47:07.715074 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.714967    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 11 17:47:07.715074 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.715053    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 17:47:07.715393 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.715360    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 11 17:47:07.715393 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.715382    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 11 17:47:07.717038 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.717015    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 11 17:47:07.728948 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.728925    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 17:47:07.752558 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.752526    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.752682 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.752562    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5m62\" (UniqueName: \"kubernetes.io/projected/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-kube-api-access-z5m62\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.752682 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.752622    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/51ed57de-bab7-4b62-93ab-e82079b839c3-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-6t4ps\" (UID: \"51ed57de-bab7-4b62-93ab-e82079b839c3\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-6t4ps"
Sep 11 17:47:07.752682 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.752649    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.752682 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.752672    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.752864 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.752692    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.752864 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.752711    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.752864 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.752728    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.752864 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.752796    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.752864 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.752843    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.753049 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.752877    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.753049 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.752902    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-config\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.753049 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.752936    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.753049 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.752959    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-config-out\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.753049 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.752974    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.753049 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.752996    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.753291 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.753051    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.753291 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.753079    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-web-config\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.753291 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.753116    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.753291 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.753166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.753291 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.753198    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.754882 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.754854    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/51ed57de-bab7-4b62-93ab-e82079b839c3-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-6t4ps\" (UID: \"51ed57de-bab7-4b62-93ab-e82079b839c3\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-6t4ps"
Sep 11 17:47:07.853771 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.853725    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-config-out\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.853937 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.853781    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.853937 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.853811    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.853937 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.853840    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.853937 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.853861    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-web-config\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.853937 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.853881    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.853937 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.853909    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.853937 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.853937    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.854272 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.853982    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.854272 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.854007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5m62\" (UniqueName: \"kubernetes.io/projected/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-kube-api-access-z5m62\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.854272 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.854045    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.854272 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.854076    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.854272 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.854108    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.854272 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.854142    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.854272 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.854173    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.854272 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.854206    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.854272 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.854258    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.854693 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.854283    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.854693 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.854306    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-config\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.854693 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.854332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.854878 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.854750    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.855064 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.855039    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.855137 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.855067    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.857042 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.856293    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.857042 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.856928    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.857263 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.857143    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-config-out\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.857263 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.857174    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.857374 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.857303    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-web-config\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.857688 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.857664    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.858364 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.858309    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.859435 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.858484    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.859435 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.858921    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.859435 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.859392    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.859928 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.859906    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.860206 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.860166    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.860695 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.860671    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.861111 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.861094    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.861229 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.861205    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.861445 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.861421    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-config\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.868245 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.868227    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5m62\" (UniqueName: \"kubernetes.io/projected/bee1fa5d-0469-4be9-a3ea-aab1e2c8face-kube-api-access-z5m62\") pod \"prometheus-k8s-0\" (UID: \"bee1fa5d-0469-4be9-a3ea-aab1e2c8face\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:07.875794 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.875771    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xjtvp\""
Sep 11 17:47:07.883823 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:07.883802    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-6t4ps"
Sep 11 17:47:08.020611 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:08.020586    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:08.101316 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:08.100450    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5" event={"ID":"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0","Type":"ContainerStarted","Data":"59a12d3ed92d062a4773f8f873d27b91c13c0c255ca5cc0b4fb590f9b0da96ca"}
Sep 11 17:47:08.210029 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:08.210003    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-6t4ps"]
Sep 11 17:47:08.212623 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:47:08.212596    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ed57de_bab7_4b62_93ab_e82079b839c3.slice/crio-9a07ff0ebb6b2a3f3f6501543e44bc38fb17097b9188b0f043fbd3402b791abd WatchSource:0}: Error finding container 9a07ff0ebb6b2a3f3f6501543e44bc38fb17097b9188b0f043fbd3402b791abd: Status 404 returned error can't find the container with id 9a07ff0ebb6b2a3f3f6501543e44bc38fb17097b9188b0f043fbd3402b791abd
Sep 11 17:47:08.339671 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:08.339644    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 17:47:08.341920 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:47:08.341893    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbee1fa5d_0469_4be9_a3ea_aab1e2c8face.slice/crio-305ab4fcaea73426ab855c6601887dfb2c1e8aa3aad3b9fcced552a4f08da6a0 WatchSource:0}: Error finding container 305ab4fcaea73426ab855c6601887dfb2c1e8aa3aad3b9fcced552a4f08da6a0: Status 404 returned error can't find the container with id 305ab4fcaea73426ab855c6601887dfb2c1e8aa3aad3b9fcced552a4f08da6a0
Sep 11 17:47:09.107558 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:09.107520    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bee1fa5d-0469-4be9-a3ea-aab1e2c8face","Type":"ContainerStarted","Data":"305ab4fcaea73426ab855c6601887dfb2c1e8aa3aad3b9fcced552a4f08da6a0"}
Sep 11 17:47:09.109568 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:09.109526    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-6t4ps" event={"ID":"51ed57de-bab7-4b62-93ab-e82079b839c3","Type":"ContainerStarted","Data":"9a07ff0ebb6b2a3f3f6501543e44bc38fb17097b9188b0f043fbd3402b791abd"}
Sep 11 17:47:09.113354 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:09.113316    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5" event={"ID":"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0","Type":"ContainerStarted","Data":"a41b9e20eb46ff66690fd1d6fa2ae02a1ab19e798d3b8e34c3da47f63d43c4af"}
Sep 11 17:47:09.113498 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:09.113386    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5" event={"ID":"cfc0cf9d-1bc8-4366-826f-1982c1ad23e0","Type":"ContainerStarted","Data":"737a589e0d32fd00081cb9ef17e2d0a255aa98e771a0376d4a3354dd14363b57"}
Sep 11 17:47:09.113964 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:09.113801    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:09.158776 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:09.158715    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5" podStartSLOduration=2.372402676 podStartE2EDuration="5.158698315s" totalImagesPullingTime="2.786295639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:47:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:47:09.157883026 +0000 UTC m=+122.083834773" watchObservedRunningTime="2026-09-11 17:47:09.158698315 +0000 UTC m=+122.084650060"
Sep 11 17:47:10.119464 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.119379    2579 generic.go:356] "Generic (PLEG): container finished" podID="bee1fa5d-0469-4be9-a3ea-aab1e2c8face" containerID="77067aa43bc0542b246813b1951570704024f37fe04198f0524d21be29dae318" exitCode=0
Sep 11 17:47:10.119972 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.119479    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bee1fa5d-0469-4be9-a3ea-aab1e2c8face","Type":"ContainerDied","Data":"77067aa43bc0542b246813b1951570704024f37fe04198f0524d21be29dae318"}
Sep 11 17:47:10.121178 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.121148    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-6t4ps" event={"ID":"51ed57de-bab7-4b62-93ab-e82079b839c3","Type":"ContainerStarted","Data":"e6d97cb7f254c0bd345ac9a0a420eaa8b3e6f8faf1b84afc18e2ea938988bf1d"}
Sep 11 17:47:10.121281 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.121202    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-6t4ps"
Sep 11 17:47:10.126555 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.126534    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-6t4ps"
Sep 11 17:47:10.203201 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.203172    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8669fcb7f7-l92fn"]
Sep 11 17:47:10.207489 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.207465    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.222237 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.222212    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 17:47:10.244593 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.244567    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8669fcb7f7-l92fn"]
Sep 11 17:47:10.254394 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.254350    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-6t4ps" podStartSLOduration=2.630580883 podStartE2EDuration="4.25433732s" totalImagesPullingTime="1.623756437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:47:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:47:10.252000229 +0000 UTC m=+123.177951977" watchObservedRunningTime="2026-09-11 17:47:10.25433732 +0000 UTC m=+123.180289065"
Sep 11 17:47:10.277262 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.277236    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-service-ca\") pod \"console-8669fcb7f7-l92fn\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") " pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.277364 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.277293    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8b040be-ac3c-43ba-9282-c10415df96d1-console-oauth-config\") pod \"console-8669fcb7f7-l92fn\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") " pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.277364 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.277313    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5wmj\" (UniqueName: \"kubernetes.io/projected/d8b040be-ac3c-43ba-9282-c10415df96d1-kube-api-access-z5wmj\") pod \"console-8669fcb7f7-l92fn\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") " pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.277472 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.277407    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-console-config\") pod \"console-8669fcb7f7-l92fn\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") " pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.277472 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.277440    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-trusted-ca-bundle\") pod \"console-8669fcb7f7-l92fn\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") " pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.277472 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.277462    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8b040be-ac3c-43ba-9282-c10415df96d1-console-serving-cert\") pod \"console-8669fcb7f7-l92fn\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") " pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.277611 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.277538    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-oauth-serving-cert\") pod \"console-8669fcb7f7-l92fn\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") " pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.378308 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.378232    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-service-ca\") pod \"console-8669fcb7f7-l92fn\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") " pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.378308 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.378300    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8b040be-ac3c-43ba-9282-c10415df96d1-console-oauth-config\") pod \"console-8669fcb7f7-l92fn\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") " pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.378487 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.378333    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5wmj\" (UniqueName: \"kubernetes.io/projected/d8b040be-ac3c-43ba-9282-c10415df96d1-kube-api-access-z5wmj\") pod \"console-8669fcb7f7-l92fn\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") " pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.378487 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.378384    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-console-config\") pod \"console-8669fcb7f7-l92fn\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") " pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.378560 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.378509    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-trusted-ca-bundle\") pod \"console-8669fcb7f7-l92fn\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") " pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.378610 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.378560    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8b040be-ac3c-43ba-9282-c10415df96d1-console-serving-cert\") pod \"console-8669fcb7f7-l92fn\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") " pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.378610 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.378603    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-oauth-serving-cert\") pod \"console-8669fcb7f7-l92fn\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") " pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.379130 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.379106    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-console-config\") pod \"console-8669fcb7f7-l92fn\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") " pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.379194 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.379104    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-service-ca\") pod \"console-8669fcb7f7-l92fn\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") " pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.379361 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.379338    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-trusted-ca-bundle\") pod \"console-8669fcb7f7-l92fn\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") " pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.379450 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.379374    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-oauth-serving-cert\") pod \"console-8669fcb7f7-l92fn\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") " pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.380851 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.380823    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8b040be-ac3c-43ba-9282-c10415df96d1-console-oauth-config\") pod \"console-8669fcb7f7-l92fn\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") " pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.381001 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.380984    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8b040be-ac3c-43ba-9282-c10415df96d1-console-serving-cert\") pod \"console-8669fcb7f7-l92fn\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") " pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.394269 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.394250    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5wmj\" (UniqueName: \"kubernetes.io/projected/d8b040be-ac3c-43ba-9282-c10415df96d1-kube-api-access-z5wmj\") pod \"console-8669fcb7f7-l92fn\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") " pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.519977 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.519938    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:10.805328 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:10.805296    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8669fcb7f7-l92fn"]
Sep 11 17:47:10.808019 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:47:10.807988    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b040be_ac3c_43ba_9282_c10415df96d1.slice/crio-f462fb28f74c1c44480369263ebb64338dec757052d7398e8c24069b2726a90e WatchSource:0}: Error finding container f462fb28f74c1c44480369263ebb64338dec757052d7398e8c24069b2726a90e: Status 404 returned error can't find the container with id f462fb28f74c1c44480369263ebb64338dec757052d7398e8c24069b2726a90e
Sep 11 17:47:11.127793 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:11.127691    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8669fcb7f7-l92fn" event={"ID":"d8b040be-ac3c-43ba-9282-c10415df96d1","Type":"ContainerStarted","Data":"304efb0aca788c171c0c9533afb06dde86900740997162a216db3db7753c4c41"}
Sep 11 17:47:11.127793 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:11.127751    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8669fcb7f7-l92fn" event={"ID":"d8b040be-ac3c-43ba-9282-c10415df96d1","Type":"ContainerStarted","Data":"f462fb28f74c1c44480369263ebb64338dec757052d7398e8c24069b2726a90e"}
Sep 11 17:47:14.143653 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:14.143614    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bee1fa5d-0469-4be9-a3ea-aab1e2c8face","Type":"ContainerStarted","Data":"e05e38c727341bbaa6873ef55c9155e86f37a57d350ac12cdfbcdd8f6cc04472"}
Sep 11 17:47:14.144048 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:14.143695    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bee1fa5d-0469-4be9-a3ea-aab1e2c8face","Type":"ContainerStarted","Data":"6432b9d6e13e913a5334767ddea7446596d6f273fb7f814dc02462a35ed29a44"}
Sep 11 17:47:14.144048 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:14.143728    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bee1fa5d-0469-4be9-a3ea-aab1e2c8face","Type":"ContainerStarted","Data":"d74cf79c67081cbc01cff339d7bcca4a84271f1f85f4c13f92433f0d4de7cac8"}
Sep 11 17:47:14.144048 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:14.143753    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bee1fa5d-0469-4be9-a3ea-aab1e2c8face","Type":"ContainerStarted","Data":"6de3833f58eaa453a0c0aaa7eae13b9f463255f207207cbb42265bdbd6c631d1"}
Sep 11 17:47:14.144048 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:14.143802    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bee1fa5d-0469-4be9-a3ea-aab1e2c8face","Type":"ContainerStarted","Data":"b2b203a38ff5b731715a11c0a1823b98fb74b1c42c07b990d4919afb6975da2d"}
Sep 11 17:47:14.144048 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:14.143828    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bee1fa5d-0469-4be9-a3ea-aab1e2c8face","Type":"ContainerStarted","Data":"dfc0550229f8f2d8a705f1c53980fc41d8e91d730ed1baa7a8b2a6cc5a4f601c"}
Sep 11 17:47:14.191601 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:14.191557    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8669fcb7f7-l92fn" podStartSLOduration=4.191543186 podStartE2EDuration="4.191543186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:47:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:47:11.153734447 +0000 UTC m=+124.079686192" watchObservedRunningTime="2026-09-11 17:47:14.191543186 +0000 UTC m=+127.117494949"
Sep 11 17:47:14.192305 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:14.192259    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.714317209 podStartE2EDuration="7.192246486s" totalImagesPullingTime="4.45835477s" totalInitContainerRuntime="19.574507ms" isStatefulPod=false podCreationTimestamp="2026-09-11 17:47:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:47:14.191227953 +0000 UTC m=+127.117179700" watchObservedRunningTime="2026-09-11 17:47:14.192246486 +0000 UTC m=+127.118198233"
Sep 11 17:47:15.127393 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:15.127367    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-78546f8bf8-ppvn5"
Sep 11 17:47:16.095084 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.095039    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc" podUID="e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd" containerName="registry" containerID="cri-o://da6ce543b21ae2918fd2e9ec4993fe9aac4b18e1fd25cc772b773865ea0f34c3" gracePeriod=30
Sep 11 17:47:16.343274 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.343246    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:47:16.439539 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.439466    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-certificates\") pod \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") "
Sep 11 17:47:16.439539 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.439531    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-tls\") pod \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") "
Sep 11 17:47:16.439703 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.439556    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-bound-sa-token\") pod \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") "
Sep 11 17:47:16.439703 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.439596    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-trusted-ca\") pod \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") "
Sep 11 17:47:16.439703 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.439626    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-installation-pull-secrets\") pod \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") "
Sep 11 17:47:16.439703 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.439682    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlxhx\" (UniqueName: \"kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-kube-api-access-qlxhx\") pod \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") "
Sep 11 17:47:16.439927 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.439709    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-ca-trust-extracted\") pod \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") "
Sep 11 17:47:16.439927 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.439755    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-image-registry-private-configuration\") pod \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\" (UID: \"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd\") "
Sep 11 17:47:16.440078 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.440054    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd" (UID: "e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:47:16.440675 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.440639    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd" (UID: "e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:47:16.442116 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.442083    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd" (UID: "e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:47:16.442210 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.442119    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-kube-api-access-qlxhx" (OuterVolumeSpecName: "kube-api-access-qlxhx") pod "e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd" (UID: "e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd"). InnerVolumeSpecName "kube-api-access-qlxhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:47:16.442263 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.442243    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd" (UID: "e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:47:16.442325 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.442302    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd" (UID: "e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:47:16.442366 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.442336    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd" (UID: "e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:47:16.448425 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.448402    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd" (UID: "e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:47:16.541275 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.541237    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-certificates\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:47:16.541275 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.541269    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-registry-tls\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:47:16.541275 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.541278    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-bound-sa-token\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:47:16.541275 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.541285    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-trusted-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:47:16.541534 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.541293    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-installation-pull-secrets\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:47:16.541534 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.541301    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlxhx\" (UniqueName: \"kubernetes.io/projected/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-kube-api-access-qlxhx\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:47:16.541534 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.541310    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-ca-trust-extracted\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:47:16.541534 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:16.541319    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd-image-registry-private-configuration\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:47:17.158417 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:17.158379    2579 generic.go:356] "Generic (PLEG): container finished" podID="e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd" containerID="da6ce543b21ae2918fd2e9ec4993fe9aac4b18e1fd25cc772b773865ea0f34c3" exitCode=0
Sep 11 17:47:17.158850 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:17.158429    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"
Sep 11 17:47:17.158850 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:17.158465    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc" event={"ID":"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd","Type":"ContainerDied","Data":"da6ce543b21ae2918fd2e9ec4993fe9aac4b18e1fd25cc772b773865ea0f34c3"}
Sep 11 17:47:17.158850 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:17.158520    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b6f54f7f7-ctmbc" event={"ID":"e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd","Type":"ContainerDied","Data":"383ba32f56b5393bd4249541bdbaf2a2dacc0d31a8de210ea32f1616c7a04bcf"}
Sep 11 17:47:17.158850 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:17.158542    2579 scope.go:117] "RemoveContainer" containerID="da6ce543b21ae2918fd2e9ec4993fe9aac4b18e1fd25cc772b773865ea0f34c3"
Sep 11 17:47:17.167432 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:17.167416    2579 scope.go:117] "RemoveContainer" containerID="da6ce543b21ae2918fd2e9ec4993fe9aac4b18e1fd25cc772b773865ea0f34c3"
Sep 11 17:47:17.167709 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:47:17.167693    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da6ce543b21ae2918fd2e9ec4993fe9aac4b18e1fd25cc772b773865ea0f34c3\": container with ID starting with da6ce543b21ae2918fd2e9ec4993fe9aac4b18e1fd25cc772b773865ea0f34c3 not found: ID does not exist" containerID="da6ce543b21ae2918fd2e9ec4993fe9aac4b18e1fd25cc772b773865ea0f34c3"
Sep 11 17:47:17.167771 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:17.167716    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da6ce543b21ae2918fd2e9ec4993fe9aac4b18e1fd25cc772b773865ea0f34c3"} err="failed to get container status \"da6ce543b21ae2918fd2e9ec4993fe9aac4b18e1fd25cc772b773865ea0f34c3\": rpc error: code = NotFound desc = could not find container \"da6ce543b21ae2918fd2e9ec4993fe9aac4b18e1fd25cc772b773865ea0f34c3\": container with ID starting with da6ce543b21ae2918fd2e9ec4993fe9aac4b18e1fd25cc772b773865ea0f34c3 not found: ID does not exist"
Sep 11 17:47:17.187122 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:17.187092    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"]
Sep 11 17:47:17.203876 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:17.203849    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5b6f54f7f7-ctmbc"]
Sep 11 17:47:17.246095 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:17.246062    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs\") pod \"network-metrics-daemon-27scn\" (UID: \"ebc8fd61-b671-4d9e-9e23-756caf55b43c\") " pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:47:17.248221 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:17.248197    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc8fd61-b671-4d9e-9e23-756caf55b43c-metrics-certs\") pod \"network-metrics-daemon-27scn\" (UID: \"ebc8fd61-b671-4d9e-9e23-756caf55b43c\") " pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:47:17.450254 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:17.450177    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jfwbq\""
Sep 11 17:47:17.457918 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:17.457898    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27scn"
Sep 11 17:47:17.534105 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:17.534077    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd" path="/var/lib/kubelet/pods/e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd/volumes"
Sep 11 17:47:17.737568 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:17.737496    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-27scn"]
Sep 11 17:47:17.741342 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:47:17.741306    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebc8fd61_b671_4d9e_9e23_756caf55b43c.slice/crio-78d40733fc0a8fbe500d0a8d1cb985235ab80df081d1056af512ecea3eaf3936 WatchSource:0}: Error finding container 78d40733fc0a8fbe500d0a8d1cb985235ab80df081d1056af512ecea3eaf3936: Status 404 returned error can't find the container with id 78d40733fc0a8fbe500d0a8d1cb985235ab80df081d1056af512ecea3eaf3936
Sep 11 17:47:18.021418 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:18.021384    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:47:18.165126 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:18.165088    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-27scn" event={"ID":"ebc8fd61-b671-4d9e-9e23-756caf55b43c","Type":"ContainerStarted","Data":"78d40733fc0a8fbe500d0a8d1cb985235ab80df081d1056af512ecea3eaf3936"}
Sep 11 17:47:19.172747 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:19.172713    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-27scn" event={"ID":"ebc8fd61-b671-4d9e-9e23-756caf55b43c","Type":"ContainerStarted","Data":"9d598e7d743f590aab70ab708194869fe2c48d00c55d40562b81b5e363be3186"}
Sep 11 17:47:19.173203 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:19.172785    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-27scn" event={"ID":"ebc8fd61-b671-4d9e-9e23-756caf55b43c","Type":"ContainerStarted","Data":"f9ae064aa5c9fd42c3b4f06734e8982a4121fac97b29f10e8e777b60fee86c80"}
Sep 11 17:47:19.191844 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:19.191783    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-27scn" podStartSLOduration=131.312647687 podStartE2EDuration="2m12.191738203s" totalImagesPullingTime="879.090516ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:47:19.191086121 +0000 UTC m=+132.117037867" watchObservedRunningTime="2026-09-11 17:47:19.191738203 +0000 UTC m=+132.117689951"
Sep 11 17:47:20.520679 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:20.520638    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:20.521079 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:20.520743    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:20.525611 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:20.525588    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:21.184080 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:21.184051    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:47:29.767597 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:29.767538    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-746b74566c-6h2hj" podUID="124c974d-f841-4579-a50b-512b832ea0ba" containerName="console" containerID="cri-o://fafb5cda9f243331ca60475f67dc7dc55ddeeaa5bdd016d76540e56b1df7af23" gracePeriod=15
Sep 11 17:47:30.015010 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.014982    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:47:30.158117 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.158029    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/124c974d-f841-4579-a50b-512b832ea0ba-console-config\") pod \"124c974d-f841-4579-a50b-512b832ea0ba\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") "
Sep 11 17:47:30.158117 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.158076    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/124c974d-f841-4579-a50b-512b832ea0ba-oauth-serving-cert\") pod \"124c974d-f841-4579-a50b-512b832ea0ba\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") "
Sep 11 17:47:30.158117 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.158104    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnn85\" (UniqueName: \"kubernetes.io/projected/124c974d-f841-4579-a50b-512b832ea0ba-kube-api-access-pnn85\") pod \"124c974d-f841-4579-a50b-512b832ea0ba\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") "
Sep 11 17:47:30.158354 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.158186    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/124c974d-f841-4579-a50b-512b832ea0ba-console-oauth-config\") pod \"124c974d-f841-4579-a50b-512b832ea0ba\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") "
Sep 11 17:47:30.158354 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.158217    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/124c974d-f841-4579-a50b-512b832ea0ba-console-serving-cert\") pod \"124c974d-f841-4579-a50b-512b832ea0ba\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") "
Sep 11 17:47:30.158354 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.158244    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/124c974d-f841-4579-a50b-512b832ea0ba-service-ca\") pod \"124c974d-f841-4579-a50b-512b832ea0ba\" (UID: \"124c974d-f841-4579-a50b-512b832ea0ba\") "
Sep 11 17:47:30.158566 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.158531    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/124c974d-f841-4579-a50b-512b832ea0ba-console-config" (OuterVolumeSpecName: "console-config") pod "124c974d-f841-4579-a50b-512b832ea0ba" (UID: "124c974d-f841-4579-a50b-512b832ea0ba"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:47:30.158650 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.158620    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/124c974d-f841-4579-a50b-512b832ea0ba-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "124c974d-f841-4579-a50b-512b832ea0ba" (UID: "124c974d-f841-4579-a50b-512b832ea0ba"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:47:30.158691 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.158660    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/124c974d-f841-4579-a50b-512b832ea0ba-service-ca" (OuterVolumeSpecName: "service-ca") pod "124c974d-f841-4579-a50b-512b832ea0ba" (UID: "124c974d-f841-4579-a50b-512b832ea0ba"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:47:30.160413 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.160387    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/124c974d-f841-4579-a50b-512b832ea0ba-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "124c974d-f841-4579-a50b-512b832ea0ba" (UID: "124c974d-f841-4579-a50b-512b832ea0ba"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:47:30.160573 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.160556    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/124c974d-f841-4579-a50b-512b832ea0ba-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "124c974d-f841-4579-a50b-512b832ea0ba" (UID: "124c974d-f841-4579-a50b-512b832ea0ba"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:47:30.160734 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.160716    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/124c974d-f841-4579-a50b-512b832ea0ba-kube-api-access-pnn85" (OuterVolumeSpecName: "kube-api-access-pnn85") pod "124c974d-f841-4579-a50b-512b832ea0ba" (UID: "124c974d-f841-4579-a50b-512b832ea0ba"). InnerVolumeSpecName "kube-api-access-pnn85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:47:30.217557 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.217528    2579 generic.go:356] "Generic (PLEG): container finished" podID="124c974d-f841-4579-a50b-512b832ea0ba" containerID="fafb5cda9f243331ca60475f67dc7dc55ddeeaa5bdd016d76540e56b1df7af23" exitCode=0
Sep 11 17:47:30.217671 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.217570    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746b74566c-6h2hj"
Sep 11 17:47:30.217671 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.217613    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746b74566c-6h2hj" event={"ID":"124c974d-f841-4579-a50b-512b832ea0ba","Type":"ContainerDied","Data":"fafb5cda9f243331ca60475f67dc7dc55ddeeaa5bdd016d76540e56b1df7af23"}
Sep 11 17:47:30.217741 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.217671    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746b74566c-6h2hj" event={"ID":"124c974d-f841-4579-a50b-512b832ea0ba","Type":"ContainerDied","Data":"093901e9d63d8b45f701cf29849f69c100e45d2356eb157132edd70835d5a671"}
Sep 11 17:47:30.217741 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.217696    2579 scope.go:117] "RemoveContainer" containerID="fafb5cda9f243331ca60475f67dc7dc55ddeeaa5bdd016d76540e56b1df7af23"
Sep 11 17:47:30.226235 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.226220    2579 scope.go:117] "RemoveContainer" containerID="fafb5cda9f243331ca60475f67dc7dc55ddeeaa5bdd016d76540e56b1df7af23"
Sep 11 17:47:30.226496 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:47:30.226478    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fafb5cda9f243331ca60475f67dc7dc55ddeeaa5bdd016d76540e56b1df7af23\": container with ID starting with fafb5cda9f243331ca60475f67dc7dc55ddeeaa5bdd016d76540e56b1df7af23 not found: ID does not exist" containerID="fafb5cda9f243331ca60475f67dc7dc55ddeeaa5bdd016d76540e56b1df7af23"
Sep 11 17:47:30.226559 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.226503    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fafb5cda9f243331ca60475f67dc7dc55ddeeaa5bdd016d76540e56b1df7af23"} err="failed to get container status \"fafb5cda9f243331ca60475f67dc7dc55ddeeaa5bdd016d76540e56b1df7af23\": rpc error: code = NotFound desc = could not find container \"fafb5cda9f243331ca60475f67dc7dc55ddeeaa5bdd016d76540e56b1df7af23\": container with ID starting with fafb5cda9f243331ca60475f67dc7dc55ddeeaa5bdd016d76540e56b1df7af23 not found: ID does not exist"
Sep 11 17:47:30.238747 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.238721    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-746b74566c-6h2hj"]
Sep 11 17:47:30.242799 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.242776    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-746b74566c-6h2hj"]
Sep 11 17:47:30.259566 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.259541    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnn85\" (UniqueName: \"kubernetes.io/projected/124c974d-f841-4579-a50b-512b832ea0ba-kube-api-access-pnn85\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:47:30.259566 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.259564    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/124c974d-f841-4579-a50b-512b832ea0ba-console-oauth-config\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:47:30.259683 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.259574    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/124c974d-f841-4579-a50b-512b832ea0ba-console-serving-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:47:30.259683 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.259584    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/124c974d-f841-4579-a50b-512b832ea0ba-service-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:47:30.259683 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.259592    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/124c974d-f841-4579-a50b-512b832ea0ba-console-config\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:47:30.259683 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:30.259600    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/124c974d-f841-4579-a50b-512b832ea0ba-oauth-serving-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:47:31.532698 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:47:31.532664    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="124c974d-f841-4579-a50b-512b832ea0ba" path="/var/lib/kubelet/pods/124c974d-f841-4579-a50b-512b832ea0ba/volumes"
Sep 11 17:48:08.021503 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:48:08.021469    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:48:08.040865 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:48:08.040836    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:48:08.387248 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:48:08.387176    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 17:48:48.142482 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:48:48.142449    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8669fcb7f7-l92fn"]
Sep 11 17:49:13.166310 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.166264    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8669fcb7f7-l92fn" podUID="d8b040be-ac3c-43ba-9282-c10415df96d1" containerName="console" containerID="cri-o://304efb0aca788c171c0c9533afb06dde86900740997162a216db3db7753c4c41" gracePeriod=15
Sep 11 17:49:13.421261 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.421196    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:49:13.509518 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.509486    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-console-config\") pod \"d8b040be-ac3c-43ba-9282-c10415df96d1\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") "
Sep 11 17:49:13.509692 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.509539    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-oauth-serving-cert\") pod \"d8b040be-ac3c-43ba-9282-c10415df96d1\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") "
Sep 11 17:49:13.509692 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.509560    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5wmj\" (UniqueName: \"kubernetes.io/projected/d8b040be-ac3c-43ba-9282-c10415df96d1-kube-api-access-z5wmj\") pod \"d8b040be-ac3c-43ba-9282-c10415df96d1\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") "
Sep 11 17:49:13.509692 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.509604    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-service-ca\") pod \"d8b040be-ac3c-43ba-9282-c10415df96d1\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") "
Sep 11 17:49:13.509845 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.509801    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8b040be-ac3c-43ba-9282-c10415df96d1-console-oauth-config\") pod \"d8b040be-ac3c-43ba-9282-c10415df96d1\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") "
Sep 11 17:49:13.509886 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.509859    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8b040be-ac3c-43ba-9282-c10415df96d1-console-serving-cert\") pod \"d8b040be-ac3c-43ba-9282-c10415df96d1\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") "
Sep 11 17:49:13.509932 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.509910    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-trusted-ca-bundle\") pod \"d8b040be-ac3c-43ba-9282-c10415df96d1\" (UID: \"d8b040be-ac3c-43ba-9282-c10415df96d1\") "
Sep 11 17:49:13.510014 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.509979    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-service-ca" (OuterVolumeSpecName: "service-ca") pod "d8b040be-ac3c-43ba-9282-c10415df96d1" (UID: "d8b040be-ac3c-43ba-9282-c10415df96d1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:49:13.510097 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.510023    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d8b040be-ac3c-43ba-9282-c10415df96d1" (UID: "d8b040be-ac3c-43ba-9282-c10415df96d1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:49:13.510097 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.509986    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-console-config" (OuterVolumeSpecName: "console-config") pod "d8b040be-ac3c-43ba-9282-c10415df96d1" (UID: "d8b040be-ac3c-43ba-9282-c10415df96d1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:49:13.510263 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.510247    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-service-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:49:13.510343 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.510268    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-console-config\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:49:13.510343 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.510281    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-oauth-serving-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:49:13.510343 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.510292    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d8b040be-ac3c-43ba-9282-c10415df96d1" (UID: "d8b040be-ac3c-43ba-9282-c10415df96d1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:49:13.511933 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.511895    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8b040be-ac3c-43ba-9282-c10415df96d1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d8b040be-ac3c-43ba-9282-c10415df96d1" (UID: "d8b040be-ac3c-43ba-9282-c10415df96d1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:49:13.512190 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.512166    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8b040be-ac3c-43ba-9282-c10415df96d1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d8b040be-ac3c-43ba-9282-c10415df96d1" (UID: "d8b040be-ac3c-43ba-9282-c10415df96d1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:49:13.512282 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.512192    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8b040be-ac3c-43ba-9282-c10415df96d1-kube-api-access-z5wmj" (OuterVolumeSpecName: "kube-api-access-z5wmj") pod "d8b040be-ac3c-43ba-9282-c10415df96d1" (UID: "d8b040be-ac3c-43ba-9282-c10415df96d1"). InnerVolumeSpecName "kube-api-access-z5wmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:49:13.611045 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.611003    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8b040be-ac3c-43ba-9282-c10415df96d1-console-oauth-config\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:49:13.611045 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.611035    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8b040be-ac3c-43ba-9282-c10415df96d1-console-serving-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:49:13.611045 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.611045    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b040be-ac3c-43ba-9282-c10415df96d1-trusted-ca-bundle\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:49:13.611045 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.611053    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5wmj\" (UniqueName: \"kubernetes.io/projected/d8b040be-ac3c-43ba-9282-c10415df96d1-kube-api-access-z5wmj\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:49:13.640777 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.640733    2579 generic.go:356] "Generic (PLEG): container finished" podID="d8b040be-ac3c-43ba-9282-c10415df96d1" containerID="304efb0aca788c171c0c9533afb06dde86900740997162a216db3db7753c4c41" exitCode=0
Sep 11 17:49:13.640936 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.640807    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8669fcb7f7-l92fn"
Sep 11 17:49:13.640936 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.640812    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8669fcb7f7-l92fn" event={"ID":"d8b040be-ac3c-43ba-9282-c10415df96d1","Type":"ContainerDied","Data":"304efb0aca788c171c0c9533afb06dde86900740997162a216db3db7753c4c41"}
Sep 11 17:49:13.640936 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.640858    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8669fcb7f7-l92fn" event={"ID":"d8b040be-ac3c-43ba-9282-c10415df96d1","Type":"ContainerDied","Data":"f462fb28f74c1c44480369263ebb64338dec757052d7398e8c24069b2726a90e"}
Sep 11 17:49:13.640936 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.640879    2579 scope.go:117] "RemoveContainer" containerID="304efb0aca788c171c0c9533afb06dde86900740997162a216db3db7753c4c41"
Sep 11 17:49:13.649022 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.649000    2579 scope.go:117] "RemoveContainer" containerID="304efb0aca788c171c0c9533afb06dde86900740997162a216db3db7753c4c41"
Sep 11 17:49:13.649281 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:49:13.649263    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"304efb0aca788c171c0c9533afb06dde86900740997162a216db3db7753c4c41\": container with ID starting with 304efb0aca788c171c0c9533afb06dde86900740997162a216db3db7753c4c41 not found: ID does not exist" containerID="304efb0aca788c171c0c9533afb06dde86900740997162a216db3db7753c4c41"
Sep 11 17:49:13.649341 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.649294    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"304efb0aca788c171c0c9533afb06dde86900740997162a216db3db7753c4c41"} err="failed to get container status \"304efb0aca788c171c0c9533afb06dde86900740997162a216db3db7753c4c41\": rpc error: code = NotFound desc = could not find container \"304efb0aca788c171c0c9533afb06dde86900740997162a216db3db7753c4c41\": container with ID starting with 304efb0aca788c171c0c9533afb06dde86900740997162a216db3db7753c4c41 not found: ID does not exist"
Sep 11 17:49:13.660622 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.660600    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8669fcb7f7-l92fn"]
Sep 11 17:49:13.674455 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:13.674385    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8669fcb7f7-l92fn"]
Sep 11 17:49:15.533004 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:49:15.532974    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8b040be-ac3c-43ba-9282-c10415df96d1" path="/var/lib/kubelet/pods/d8b040be-ac3c-43ba-9282-c10415df96d1/volumes"
Sep 11 17:50:07.434243 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:07.434205    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-bbhjk_46c0eccf-9fc2-4fbf-ae39-3b1cf093b352/console-operator/1.log"
Sep 11 17:50:07.438128 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:07.438105    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zx6_cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd/ovn-acl-logging/0.log"
Sep 11 17:50:07.438312 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:07.438289    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-bbhjk_46c0eccf-9fc2-4fbf-ae39-3b1cf093b352/console-operator/1.log"
Sep 11 17:50:07.443051 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:07.443028    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zx6_cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd/ovn-acl-logging/0.log"
Sep 11 17:50:07.445971 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:07.445943    2579 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 17:50:42.397616 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.397580    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-m72r7"]
Sep 11 17:50:42.400067 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.397893    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b040be-ac3c-43ba-9282-c10415df96d1" containerName="console"
Sep 11 17:50:42.400067 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.397904    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b040be-ac3c-43ba-9282-c10415df96d1" containerName="console"
Sep 11 17:50:42.400067 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.397916    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd" containerName="registry"
Sep 11 17:50:42.400067 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.397921    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd" containerName="registry"
Sep 11 17:50:42.400067 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.397931    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="124c974d-f841-4579-a50b-512b832ea0ba" containerName="console"
Sep 11 17:50:42.400067 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.397936    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="124c974d-f841-4579-a50b-512b832ea0ba" containerName="console"
Sep 11 17:50:42.400067 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.397992    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8b040be-ac3c-43ba-9282-c10415df96d1" containerName="console"
Sep 11 17:50:42.400067 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.397998    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9aed4f0-ec68-45f1-afd8-276cf0d4a2cd" containerName="registry"
Sep 11 17:50:42.400067 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.398006    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="124c974d-f841-4579-a50b-512b832ea0ba" containerName="console"
Sep 11 17:50:42.400901 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.400885    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-m72r7"
Sep 11 17:50:42.403107 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.403091    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-h4d65\""
Sep 11 17:50:42.403152 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.403112    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 17:50:42.403640 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.403626    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 17:50:42.409339 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.409315    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-m72r7"]
Sep 11 17:50:42.525591 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.525544    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vzft\" (UniqueName: \"kubernetes.io/projected/27f99091-38b3-4cd1-ac29-cb6d531c5e8c-kube-api-access-5vzft\") pod \"cert-manager-webhook-6486ffd997-m72r7\" (UID: \"27f99091-38b3-4cd1-ac29-cb6d531c5e8c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m72r7"
Sep 11 17:50:42.525795 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.525638    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/27f99091-38b3-4cd1-ac29-cb6d531c5e8c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-m72r7\" (UID: \"27f99091-38b3-4cd1-ac29-cb6d531c5e8c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m72r7"
Sep 11 17:50:42.626834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.626800    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vzft\" (UniqueName: \"kubernetes.io/projected/27f99091-38b3-4cd1-ac29-cb6d531c5e8c-kube-api-access-5vzft\") pod \"cert-manager-webhook-6486ffd997-m72r7\" (UID: \"27f99091-38b3-4cd1-ac29-cb6d531c5e8c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m72r7"
Sep 11 17:50:42.627027 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.626846    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/27f99091-38b3-4cd1-ac29-cb6d531c5e8c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-m72r7\" (UID: \"27f99091-38b3-4cd1-ac29-cb6d531c5e8c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m72r7"
Sep 11 17:50:42.635834 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.635810    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/27f99091-38b3-4cd1-ac29-cb6d531c5e8c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-m72r7\" (UID: \"27f99091-38b3-4cd1-ac29-cb6d531c5e8c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m72r7"
Sep 11 17:50:42.636014 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.635997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vzft\" (UniqueName: \"kubernetes.io/projected/27f99091-38b3-4cd1-ac29-cb6d531c5e8c-kube-api-access-5vzft\") pod \"cert-manager-webhook-6486ffd997-m72r7\" (UID: \"27f99091-38b3-4cd1-ac29-cb6d531c5e8c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m72r7"
Sep 11 17:50:42.725317 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:42.725238    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-m72r7"
Sep 11 17:50:43.021472 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:43.021441    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-m72r7"]
Sep 11 17:50:43.024695 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:50:43.024665    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27f99091_38b3_4cd1_ac29_cb6d531c5e8c.slice/crio-d166e2a639471f0f8133d04ac830237ee519d7b369e49ad81904922f46d88a78 WatchSource:0}: Error finding container d166e2a639471f0f8133d04ac830237ee519d7b369e49ad81904922f46d88a78: Status 404 returned error can't find the container with id d166e2a639471f0f8133d04ac830237ee519d7b369e49ad81904922f46d88a78
Sep 11 17:50:43.026678 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:43.026660    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 17:50:43.992026 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:43.991987    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-m72r7" event={"ID":"27f99091-38b3-4cd1-ac29-cb6d531c5e8c","Type":"ContainerStarted","Data":"d166e2a639471f0f8133d04ac830237ee519d7b369e49ad81904922f46d88a78"}
Sep 11 17:50:46.002313 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:46.002278    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-m72r7" event={"ID":"27f99091-38b3-4cd1-ac29-cb6d531c5e8c","Type":"ContainerStarted","Data":"9f9ccc961827c244c8dbec40bfb2f82d4949d28b6e4dc70db2a8bfa44ac68120"}
Sep 11 17:50:46.002659 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:46.002399    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-m72r7"
Sep 11 17:50:46.021696 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:46.021650    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-m72r7" podStartSLOduration=1.153929433 podStartE2EDuration="4.02163534s" totalImagesPullingTime="2.867705907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:50:46.020244308 +0000 UTC m=+338.946196057" watchObservedRunningTime="2026-09-11 17:50:46.02163534 +0000 UTC m=+338.947587085"
Sep 11 17:50:49.986376 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:49.986342    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w4fph"]
Sep 11 17:50:49.989529 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:49.989512    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w4fph"
Sep 11 17:50:49.994032 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:49.994011    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-r9sh8\""
Sep 11 17:50:49.994501 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:49.994484    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 17:50:49.994595 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:49.994499    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 17:50:50.005210 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:50.005187    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w4fph"]
Sep 11 17:50:50.092387 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:50.092346    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23b40023-b096-4f78-82b6-88426ca96dae-tmp\") pod \"openshift-lws-operator-fd8ccff4c-w4fph\" (UID: \"23b40023-b096-4f78-82b6-88426ca96dae\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w4fph"
Sep 11 17:50:50.092553 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:50.092387    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bsrc\" (UniqueName: \"kubernetes.io/projected/23b40023-b096-4f78-82b6-88426ca96dae-kube-api-access-6bsrc\") pod \"openshift-lws-operator-fd8ccff4c-w4fph\" (UID: \"23b40023-b096-4f78-82b6-88426ca96dae\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w4fph"
Sep 11 17:50:50.193216 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:50.193177    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23b40023-b096-4f78-82b6-88426ca96dae-tmp\") pod \"openshift-lws-operator-fd8ccff4c-w4fph\" (UID: \"23b40023-b096-4f78-82b6-88426ca96dae\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w4fph"
Sep 11 17:50:50.193381 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:50.193227    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bsrc\" (UniqueName: \"kubernetes.io/projected/23b40023-b096-4f78-82b6-88426ca96dae-kube-api-access-6bsrc\") pod \"openshift-lws-operator-fd8ccff4c-w4fph\" (UID: \"23b40023-b096-4f78-82b6-88426ca96dae\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w4fph"
Sep 11 17:50:50.193573 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:50.193553    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23b40023-b096-4f78-82b6-88426ca96dae-tmp\") pod \"openshift-lws-operator-fd8ccff4c-w4fph\" (UID: \"23b40023-b096-4f78-82b6-88426ca96dae\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w4fph"
Sep 11 17:50:50.203147 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:50.203115    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bsrc\" (UniqueName: \"kubernetes.io/projected/23b40023-b096-4f78-82b6-88426ca96dae-kube-api-access-6bsrc\") pod \"openshift-lws-operator-fd8ccff4c-w4fph\" (UID: \"23b40023-b096-4f78-82b6-88426ca96dae\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w4fph"
Sep 11 17:50:50.298198 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:50.298157    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w4fph"
Sep 11 17:50:50.577188 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:50.577088    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w4fph"]
Sep 11 17:50:50.580009 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:50:50.579984    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23b40023_b096_4f78_82b6_88426ca96dae.slice/crio-e3563cad137245f3d9ec97660635de369885462929eb246da95cdca7e48fa38b WatchSource:0}: Error finding container e3563cad137245f3d9ec97660635de369885462929eb246da95cdca7e48fa38b: Status 404 returned error can't find the container with id e3563cad137245f3d9ec97660635de369885462929eb246da95cdca7e48fa38b
Sep 11 17:50:51.020826 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:51.020790    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w4fph" event={"ID":"23b40023-b096-4f78-82b6-88426ca96dae","Type":"ContainerStarted","Data":"e3563cad137245f3d9ec97660635de369885462929eb246da95cdca7e48fa38b"}
Sep 11 17:50:52.009047 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:52.009017    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-m72r7"
Sep 11 17:50:53.031017 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:53.030983    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w4fph" event={"ID":"23b40023-b096-4f78-82b6-88426ca96dae","Type":"ContainerStarted","Data":"07a125c9fe375b75d1b2177867fdb67ffbc5883c2f08f54393e7cbbdca2805ae"}
Sep 11 17:50:53.051251 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:50:53.051202    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w4fph" podStartSLOduration=1.736223091 podStartE2EDuration="4.051186759s" totalImagesPullingTime="2.314963668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:50:53.049492268 +0000 UTC m=+345.975444015" watchObservedRunningTime="2026-09-11 17:50:53.051186759 +0000 UTC m=+345.977138504"
Sep 11 17:51:08.766324 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.766253    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"]
Sep 11 17:51:08.793715 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.793687    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"
Sep 11 17:51:08.800339 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.800277    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 17:51:08.800438 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.800417    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lgb85\""
Sep 11 17:51:08.801175 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.801149    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 17:51:08.801943 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.801926    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 17:51:08.802040 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.801960    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 17:51:08.831022 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.830923    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"]
Sep 11 17:51:08.854685 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.854653    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d4af3d8-024c-4732-afe9-15e7f59a73aa-tmp\") pod \"opendatahub-operator-controller-manager-6f44bff486-vqrdn\" (UID: \"4d4af3d8-024c-4732-afe9-15e7f59a73aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"
Sep 11 17:51:08.854875 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.854710    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhqrb\" (UniqueName: \"kubernetes.io/projected/4d4af3d8-024c-4732-afe9-15e7f59a73aa-kube-api-access-zhqrb\") pod \"opendatahub-operator-controller-manager-6f44bff486-vqrdn\" (UID: \"4d4af3d8-024c-4732-afe9-15e7f59a73aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"
Sep 11 17:51:08.854875 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.854817    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d4af3d8-024c-4732-afe9-15e7f59a73aa-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f44bff486-vqrdn\" (UID: \"4d4af3d8-024c-4732-afe9-15e7f59a73aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"
Sep 11 17:51:08.854963 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.854873    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4d4af3d8-024c-4732-afe9-15e7f59a73aa-manifests\") pod \"opendatahub-operator-controller-manager-6f44bff486-vqrdn\" (UID: \"4d4af3d8-024c-4732-afe9-15e7f59a73aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"
Sep 11 17:51:08.855009 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.854945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4d4af3d8-024c-4732-afe9-15e7f59a73aa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f44bff486-vqrdn\" (UID: \"4d4af3d8-024c-4732-afe9-15e7f59a73aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"
Sep 11 17:51:08.955465 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.955427    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhqrb\" (UniqueName: \"kubernetes.io/projected/4d4af3d8-024c-4732-afe9-15e7f59a73aa-kube-api-access-zhqrb\") pod \"opendatahub-operator-controller-manager-6f44bff486-vqrdn\" (UID: \"4d4af3d8-024c-4732-afe9-15e7f59a73aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"
Sep 11 17:51:08.955638 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.955483    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d4af3d8-024c-4732-afe9-15e7f59a73aa-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f44bff486-vqrdn\" (UID: \"4d4af3d8-024c-4732-afe9-15e7f59a73aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"
Sep 11 17:51:08.955638 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.955529    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4d4af3d8-024c-4732-afe9-15e7f59a73aa-manifests\") pod \"opendatahub-operator-controller-manager-6f44bff486-vqrdn\" (UID: \"4d4af3d8-024c-4732-afe9-15e7f59a73aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"
Sep 11 17:51:08.955638 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.955561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4d4af3d8-024c-4732-afe9-15e7f59a73aa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f44bff486-vqrdn\" (UID: \"4d4af3d8-024c-4732-afe9-15e7f59a73aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"
Sep 11 17:51:08.955638 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.955603    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d4af3d8-024c-4732-afe9-15e7f59a73aa-tmp\") pod \"opendatahub-operator-controller-manager-6f44bff486-vqrdn\" (UID: \"4d4af3d8-024c-4732-afe9-15e7f59a73aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"
Sep 11 17:51:08.955945 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.955914    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4d4af3d8-024c-4732-afe9-15e7f59a73aa-manifests\") pod \"opendatahub-operator-controller-manager-6f44bff486-vqrdn\" (UID: \"4d4af3d8-024c-4732-afe9-15e7f59a73aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"
Sep 11 17:51:08.957823 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.957802    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d4af3d8-024c-4732-afe9-15e7f59a73aa-tmp\") pod \"opendatahub-operator-controller-manager-6f44bff486-vqrdn\" (UID: \"4d4af3d8-024c-4732-afe9-15e7f59a73aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"
Sep 11 17:51:08.958081 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.958061    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4d4af3d8-024c-4732-afe9-15e7f59a73aa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f44bff486-vqrdn\" (UID: \"4d4af3d8-024c-4732-afe9-15e7f59a73aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"
Sep 11 17:51:08.958081 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.958071    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d4af3d8-024c-4732-afe9-15e7f59a73aa-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f44bff486-vqrdn\" (UID: \"4d4af3d8-024c-4732-afe9-15e7f59a73aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"
Sep 11 17:51:08.968470 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:08.968440    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhqrb\" (UniqueName: \"kubernetes.io/projected/4d4af3d8-024c-4732-afe9-15e7f59a73aa-kube-api-access-zhqrb\") pod \"opendatahub-operator-controller-manager-6f44bff486-vqrdn\" (UID: \"4d4af3d8-024c-4732-afe9-15e7f59a73aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"
Sep 11 17:51:09.103872 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:09.103791    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"
Sep 11 17:51:09.413827 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:09.413727    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"]
Sep 11 17:51:09.416985 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:51:09.416956    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d4af3d8_024c_4732_afe9_15e7f59a73aa.slice/crio-f5895fc5689c5ca38e6cec84f5ec16a2f723cff4d5093bd2849733c9460abb4d WatchSource:0}: Error finding container f5895fc5689c5ca38e6cec84f5ec16a2f723cff4d5093bd2849733c9460abb4d: Status 404 returned error can't find the container with id f5895fc5689c5ca38e6cec84f5ec16a2f723cff4d5093bd2849733c9460abb4d
Sep 11 17:51:10.107262 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:10.107225    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn" event={"ID":"4d4af3d8-024c-4732-afe9-15e7f59a73aa","Type":"ContainerStarted","Data":"f5895fc5689c5ca38e6cec84f5ec16a2f723cff4d5093bd2849733c9460abb4d"}
Sep 11 17:51:13.123299 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:13.123265    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn" event={"ID":"4d4af3d8-024c-4732-afe9-15e7f59a73aa","Type":"ContainerStarted","Data":"a139ff9f417aaaefed96d5d429eab30c1356877c0be61a80f8112c41f43a5cbb"}
Sep 11 17:51:14.129851 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:14.129816    2579 generic.go:356] "Generic (PLEG): container finished" podID="4d4af3d8-024c-4732-afe9-15e7f59a73aa" containerID="a139ff9f417aaaefed96d5d429eab30c1356877c0be61a80f8112c41f43a5cbb" exitCode=0
Sep 11 17:51:14.130374 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:14.129902    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn" event={"ID":"4d4af3d8-024c-4732-afe9-15e7f59a73aa","Type":"ContainerDied","Data":"a139ff9f417aaaefed96d5d429eab30c1356877c0be61a80f8112c41f43a5cbb"}
Sep 11 17:51:15.138221 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:15.138189    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn" event={"ID":"4d4af3d8-024c-4732-afe9-15e7f59a73aa","Type":"ContainerStarted","Data":"5f7fd72e901613faf67319c01165829f9cc2b91e1d71e00eb216b8ad43a69a30"}
Sep 11 17:51:15.138647 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:15.138320    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"
Sep 11 17:51:15.163344 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:15.163243    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn" podStartSLOduration=2.177245083 podStartE2EDuration="7.163225054s" totalImagesPullingTime="3.93231415s" totalInitContainerRuntime="1.053665821s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:51:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:51:15.161664346 +0000 UTC m=+368.087616093" watchObservedRunningTime="2026-09-11 17:51:15.163225054 +0000 UTC m=+368.089176801"
Sep 11 17:51:26.145185 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.145152    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-vqrdn"
Sep 11 17:51:26.212261 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.212230    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs"]
Sep 11 17:51:26.217721 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.217697    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs"
Sep 11 17:51:26.222458 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.222438    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 17:51:26.223109 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.223091    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 17:51:26.223597 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.223579    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lj67d\""
Sep 11 17:51:26.225286 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.225262    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 17:51:26.246088 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.246059    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs"]
Sep 11 17:51:26.302027 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.301999    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19384377-2e88-469f-b335-be97f1e7529d-cert\") pod \"lws-controller-manager-f67fb7585-dxhcs\" (UID: \"19384377-2e88-469f-b335-be97f1e7529d\") " pod="openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs"
Sep 11 17:51:26.302187 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.302058    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/19384377-2e88-469f-b335-be97f1e7529d-manager-config\") pod \"lws-controller-manager-f67fb7585-dxhcs\" (UID: \"19384377-2e88-469f-b335-be97f1e7529d\") " pod="openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs"
Sep 11 17:51:26.302187 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.302090    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/19384377-2e88-469f-b335-be97f1e7529d-metrics-cert\") pod \"lws-controller-manager-f67fb7585-dxhcs\" (UID: \"19384377-2e88-469f-b335-be97f1e7529d\") " pod="openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs"
Sep 11 17:51:26.302187 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.302162    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp62m\" (UniqueName: \"kubernetes.io/projected/19384377-2e88-469f-b335-be97f1e7529d-kube-api-access-zp62m\") pod \"lws-controller-manager-f67fb7585-dxhcs\" (UID: \"19384377-2e88-469f-b335-be97f1e7529d\") " pod="openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs"
Sep 11 17:51:26.403160 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.403075    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/19384377-2e88-469f-b335-be97f1e7529d-manager-config\") pod \"lws-controller-manager-f67fb7585-dxhcs\" (UID: \"19384377-2e88-469f-b335-be97f1e7529d\") " pod="openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs"
Sep 11 17:51:26.403160 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.403112    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/19384377-2e88-469f-b335-be97f1e7529d-metrics-cert\") pod \"lws-controller-manager-f67fb7585-dxhcs\" (UID: \"19384377-2e88-469f-b335-be97f1e7529d\") " pod="openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs"
Sep 11 17:51:26.403160 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.403146    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp62m\" (UniqueName: \"kubernetes.io/projected/19384377-2e88-469f-b335-be97f1e7529d-kube-api-access-zp62m\") pod \"lws-controller-manager-f67fb7585-dxhcs\" (UID: \"19384377-2e88-469f-b335-be97f1e7529d\") " pod="openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs"
Sep 11 17:51:26.403364 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.403199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19384377-2e88-469f-b335-be97f1e7529d-cert\") pod \"lws-controller-manager-f67fb7585-dxhcs\" (UID: \"19384377-2e88-469f-b335-be97f1e7529d\") " pod="openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs"
Sep 11 17:51:26.403857 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.403836    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/19384377-2e88-469f-b335-be97f1e7529d-manager-config\") pod \"lws-controller-manager-f67fb7585-dxhcs\" (UID: \"19384377-2e88-469f-b335-be97f1e7529d\") " pod="openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs"
Sep 11 17:51:26.405650 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.405631    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/19384377-2e88-469f-b335-be97f1e7529d-metrics-cert\") pod \"lws-controller-manager-f67fb7585-dxhcs\" (UID: \"19384377-2e88-469f-b335-be97f1e7529d\") " pod="openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs"
Sep 11 17:51:26.405740 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.405671    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19384377-2e88-469f-b335-be97f1e7529d-cert\") pod \"lws-controller-manager-f67fb7585-dxhcs\" (UID: \"19384377-2e88-469f-b335-be97f1e7529d\") " pod="openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs"
Sep 11 17:51:26.430356 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.430324    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp62m\" (UniqueName: \"kubernetes.io/projected/19384377-2e88-469f-b335-be97f1e7529d-kube-api-access-zp62m\") pod \"lws-controller-manager-f67fb7585-dxhcs\" (UID: \"19384377-2e88-469f-b335-be97f1e7529d\") " pod="openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs"
Sep 11 17:51:26.526108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.526067    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs"
Sep 11 17:51:26.839686 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:26.839654    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs"]
Sep 11 17:51:26.841888 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:51:26.841861    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19384377_2e88_469f_b335_be97f1e7529d.slice/crio-13a95bfdea8e39850bb00dd0756067292bf2f846a4bbd845636e72f4a4e1c91a WatchSource:0}: Error finding container 13a95bfdea8e39850bb00dd0756067292bf2f846a4bbd845636e72f4a4e1c91a: Status 404 returned error can't find the container with id 13a95bfdea8e39850bb00dd0756067292bf2f846a4bbd845636e72f4a4e1c91a
Sep 11 17:51:27.190393 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:27.190298    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs" event={"ID":"19384377-2e88-469f-b335-be97f1e7529d","Type":"ContainerStarted","Data":"13a95bfdea8e39850bb00dd0756067292bf2f846a4bbd845636e72f4a4e1c91a"}
Sep 11 17:51:29.200926 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:29.200893    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs" event={"ID":"19384377-2e88-469f-b335-be97f1e7529d","Type":"ContainerStarted","Data":"cec1e824d06a07ae0f99c53b8be30a2e53c702d5729ddf438ebee117262ace4d"}
Sep 11 17:51:29.201289 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:29.201020    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs"
Sep 11 17:51:29.270611 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:29.270556    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs" podStartSLOduration=1.8848718290000002 podStartE2EDuration="3.270540866s" totalImagesPullingTime="1.385669037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:51:29.26606672 +0000 UTC m=+382.192018467" watchObservedRunningTime="2026-09-11 17:51:29.270540866 +0000 UTC m=+382.196492685"
Sep 11 17:51:37.512629 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.512597    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"]
Sep 11 17:51:37.515167 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.515147    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.519111 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.519088    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 17:51:37.519414 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.519390    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-rz9qd\""
Sep 11 17:51:37.520056 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.520040    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 17:51:37.520290 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.520274    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 17:51:37.538182 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.538152    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"]
Sep 11 17:51:37.601355 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.601320    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6e3def9-2868-4b61-a0e5-836df8bde7d1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.601355 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.601358    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e3def9-2868-4b61-a0e5-836df8bde7d1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.601576 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.601411    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbshq\" (UniqueName: \"kubernetes.io/projected/c6e3def9-2868-4b61-a0e5-836df8bde7d1-kube-api-access-bbshq\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.601576 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.601456    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6e3def9-2868-4b61-a0e5-836df8bde7d1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.601576 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.601476    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6e3def9-2868-4b61-a0e5-836df8bde7d1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.601576 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.601505    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6e3def9-2868-4b61-a0e5-836df8bde7d1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.601866 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.601649    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e3def9-2868-4b61-a0e5-836df8bde7d1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.601866 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.601690    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6e3def9-2868-4b61-a0e5-836df8bde7d1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.601866 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.601740    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6e3def9-2868-4b61-a0e5-836df8bde7d1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.703071 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.703031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6e3def9-2868-4b61-a0e5-836df8bde7d1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.703071 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.703068    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e3def9-2868-4b61-a0e5-836df8bde7d1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.703314 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.703092    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbshq\" (UniqueName: \"kubernetes.io/projected/c6e3def9-2868-4b61-a0e5-836df8bde7d1-kube-api-access-bbshq\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.703314 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.703126    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6e3def9-2868-4b61-a0e5-836df8bde7d1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.703314 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.703145    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6e3def9-2868-4b61-a0e5-836df8bde7d1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.703314 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.703172    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6e3def9-2868-4b61-a0e5-836df8bde7d1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.703314 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.703216    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e3def9-2868-4b61-a0e5-836df8bde7d1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.703314 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.703239    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6e3def9-2868-4b61-a0e5-836df8bde7d1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.703314 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.703280    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6e3def9-2868-4b61-a0e5-836df8bde7d1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.704062 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.704007    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6e3def9-2868-4b61-a0e5-836df8bde7d1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.704188 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.704080    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6e3def9-2868-4b61-a0e5-836df8bde7d1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.704188 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.704139    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e3def9-2868-4b61-a0e5-836df8bde7d1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.704310 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.704216    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e3def9-2868-4b61-a0e5-836df8bde7d1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.704310 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.704244    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6e3def9-2868-4b61-a0e5-836df8bde7d1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.705670 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.705639    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6e3def9-2868-4b61-a0e5-836df8bde7d1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.705946 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.705925    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6e3def9-2868-4b61-a0e5-836df8bde7d1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.715055 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.715033    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6e3def9-2868-4b61-a0e5-836df8bde7d1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.715276 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.715256    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbshq\" (UniqueName: \"kubernetes.io/projected/c6e3def9-2868-4b61-a0e5-836df8bde7d1-kube-api-access-bbshq\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt\" (UID: \"c6e3def9-2868-4b61-a0e5-836df8bde7d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:37.826511 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:37.826424    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:38.103680 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:38.103604    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"]
Sep 11 17:51:38.106875 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:51:38.106841    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6e3def9_2868_4b61_a0e5_836df8bde7d1.slice/crio-9ad6f9f4f4e0be03433d930189bfab0d6fd8317dbb463ff8c36fb68f03fc489c WatchSource:0}: Error finding container 9ad6f9f4f4e0be03433d930189bfab0d6fd8317dbb463ff8c36fb68f03fc489c: Status 404 returned error can't find the container with id 9ad6f9f4f4e0be03433d930189bfab0d6fd8317dbb463ff8c36fb68f03fc489c
Sep 11 17:51:38.244940 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:38.244781    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt" event={"ID":"c6e3def9-2868-4b61-a0e5-836df8bde7d1","Type":"ContainerStarted","Data":"9ad6f9f4f4e0be03433d930189bfab0d6fd8317dbb463ff8c36fb68f03fc489c"}
Sep 11 17:51:39.834140 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:39.834103    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9x8lq"]
Sep 11 17:51:39.838452 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:39.838429    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9x8lq"
Sep 11 17:51:39.840482 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:39.840458    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 11 17:51:39.840599 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:39.840465    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-kwt6d\""
Sep 11 17:51:39.850360 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:39.850337    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9x8lq"]
Sep 11 17:51:39.925568 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:39.925534    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11cb31a3-3a26-4914-ad94-3e265a921326-cert\") pod \"odh-model-controller-7998c67dc4-9x8lq\" (UID: \"11cb31a3-3a26-4914-ad94-3e265a921326\") " pod="opendatahub/odh-model-controller-7998c67dc4-9x8lq"
Sep 11 17:51:39.925750 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:39.925657    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5wzq\" (UniqueName: \"kubernetes.io/projected/11cb31a3-3a26-4914-ad94-3e265a921326-kube-api-access-l5wzq\") pod \"odh-model-controller-7998c67dc4-9x8lq\" (UID: \"11cb31a3-3a26-4914-ad94-3e265a921326\") " pod="opendatahub/odh-model-controller-7998c67dc4-9x8lq"
Sep 11 17:51:40.026638 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:40.026595    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5wzq\" (UniqueName: \"kubernetes.io/projected/11cb31a3-3a26-4914-ad94-3e265a921326-kube-api-access-l5wzq\") pod \"odh-model-controller-7998c67dc4-9x8lq\" (UID: \"11cb31a3-3a26-4914-ad94-3e265a921326\") " pod="opendatahub/odh-model-controller-7998c67dc4-9x8lq"
Sep 11 17:51:40.026842 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:40.026695    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11cb31a3-3a26-4914-ad94-3e265a921326-cert\") pod \"odh-model-controller-7998c67dc4-9x8lq\" (UID: \"11cb31a3-3a26-4914-ad94-3e265a921326\") " pod="opendatahub/odh-model-controller-7998c67dc4-9x8lq"
Sep 11 17:51:40.026842 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:40.026820    2579 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 11 17:51:40.026944 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:40.026876    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cb31a3-3a26-4914-ad94-3e265a921326-cert podName:11cb31a3-3a26-4914-ad94-3e265a921326 nodeName:}" failed. No retries permitted until 2026-09-11 17:51:40.526857641 +0000 UTC m=+393.452809366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/11cb31a3-3a26-4914-ad94-3e265a921326-cert") pod "odh-model-controller-7998c67dc4-9x8lq" (UID: "11cb31a3-3a26-4914-ad94-3e265a921326") : secret "odh-model-controller-webhook-cert" not found
Sep 11 17:51:40.046219 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:40.046182    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5wzq\" (UniqueName: \"kubernetes.io/projected/11cb31a3-3a26-4914-ad94-3e265a921326-kube-api-access-l5wzq\") pod \"odh-model-controller-7998c67dc4-9x8lq\" (UID: \"11cb31a3-3a26-4914-ad94-3e265a921326\") " pod="opendatahub/odh-model-controller-7998c67dc4-9x8lq"
Sep 11 17:51:40.207617 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:40.207541    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-f67fb7585-dxhcs"
Sep 11 17:51:40.352183 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:40.352141    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pn8tm"]
Sep 11 17:51:40.356639 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:40.356614    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pn8tm"
Sep 11 17:51:40.360617 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:40.360587    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 11 17:51:40.373900 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:40.373872    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pn8tm"]
Sep 11 17:51:40.430877 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:40.430832    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6lnx\" (UniqueName: \"kubernetes.io/projected/2ca19e07-7926-4de6-afcd-6e314a975d44-kube-api-access-t6lnx\") pod \"model-serving-api-54d89bd5fc-pn8tm\" (UID: \"2ca19e07-7926-4de6-afcd-6e314a975d44\") " pod="opendatahub/model-serving-api-54d89bd5fc-pn8tm"
Sep 11 17:51:40.431057 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:40.431034    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ca19e07-7926-4de6-afcd-6e314a975d44-tls-certs\") pod \"model-serving-api-54d89bd5fc-pn8tm\" (UID: \"2ca19e07-7926-4de6-afcd-6e314a975d44\") " pod="opendatahub/model-serving-api-54d89bd5fc-pn8tm"
Sep 11 17:51:40.532037 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:40.531999    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6lnx\" (UniqueName: \"kubernetes.io/projected/2ca19e07-7926-4de6-afcd-6e314a975d44-kube-api-access-t6lnx\") pod \"model-serving-api-54d89bd5fc-pn8tm\" (UID: \"2ca19e07-7926-4de6-afcd-6e314a975d44\") " pod="opendatahub/model-serving-api-54d89bd5fc-pn8tm"
Sep 11 17:51:40.532218 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:40.532094    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11cb31a3-3a26-4914-ad94-3e265a921326-cert\") pod \"odh-model-controller-7998c67dc4-9x8lq\" (UID: \"11cb31a3-3a26-4914-ad94-3e265a921326\") " pod="opendatahub/odh-model-controller-7998c67dc4-9x8lq"
Sep 11 17:51:40.532218 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:40.532126    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ca19e07-7926-4de6-afcd-6e314a975d44-tls-certs\") pod \"model-serving-api-54d89bd5fc-pn8tm\" (UID: \"2ca19e07-7926-4de6-afcd-6e314a975d44\") " pod="opendatahub/model-serving-api-54d89bd5fc-pn8tm"
Sep 11 17:51:40.532301 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:40.532249    2579 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 11 17:51:40.532335 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:40.532314    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca19e07-7926-4de6-afcd-6e314a975d44-tls-certs podName:2ca19e07-7926-4de6-afcd-6e314a975d44 nodeName:}" failed. No retries permitted until 2026-09-11 17:51:41.032299407 +0000 UTC m=+393.958251131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2ca19e07-7926-4de6-afcd-6e314a975d44-tls-certs") pod "model-serving-api-54d89bd5fc-pn8tm" (UID: "2ca19e07-7926-4de6-afcd-6e314a975d44") : secret "model-serving-api-tls" not found
Sep 11 17:51:40.532335 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:40.532249    2579 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 11 17:51:40.532411 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:40.532380    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cb31a3-3a26-4914-ad94-3e265a921326-cert podName:11cb31a3-3a26-4914-ad94-3e265a921326 nodeName:}" failed. No retries permitted until 2026-09-11 17:51:41.532368145 +0000 UTC m=+394.458319878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/11cb31a3-3a26-4914-ad94-3e265a921326-cert") pod "odh-model-controller-7998c67dc4-9x8lq" (UID: "11cb31a3-3a26-4914-ad94-3e265a921326") : secret "odh-model-controller-webhook-cert" not found
Sep 11 17:51:40.542573 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:40.542542    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6lnx\" (UniqueName: \"kubernetes.io/projected/2ca19e07-7926-4de6-afcd-6e314a975d44-kube-api-access-t6lnx\") pod \"model-serving-api-54d89bd5fc-pn8tm\" (UID: \"2ca19e07-7926-4de6-afcd-6e314a975d44\") " pod="opendatahub/model-serving-api-54d89bd5fc-pn8tm"
Sep 11 17:51:40.556610 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:40.556577    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:51:40.556681 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:40.556653    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:51:40.556722 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:40.556688    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:51:41.038180 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:41.038144    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ca19e07-7926-4de6-afcd-6e314a975d44-tls-certs\") pod \"model-serving-api-54d89bd5fc-pn8tm\" (UID: \"2ca19e07-7926-4de6-afcd-6e314a975d44\") " pod="opendatahub/model-serving-api-54d89bd5fc-pn8tm"
Sep 11 17:51:41.040585 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:41.040560    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ca19e07-7926-4de6-afcd-6e314a975d44-tls-certs\") pod \"model-serving-api-54d89bd5fc-pn8tm\" (UID: \"2ca19e07-7926-4de6-afcd-6e314a975d44\") " pod="opendatahub/model-serving-api-54d89bd5fc-pn8tm"
Sep 11 17:51:41.262726 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:41.262691    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt" event={"ID":"c6e3def9-2868-4b61-a0e5-836df8bde7d1","Type":"ContainerStarted","Data":"3e6f46f48dbf13dae3fa4a5333d90ac4b3cdd00c6be9337f6595dc7359c27352"}
Sep 11 17:51:41.277746 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:41.277724    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pn8tm"
Sep 11 17:51:41.544442 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:41.544365    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11cb31a3-3a26-4914-ad94-3e265a921326-cert\") pod \"odh-model-controller-7998c67dc4-9x8lq\" (UID: \"11cb31a3-3a26-4914-ad94-3e265a921326\") " pod="opendatahub/odh-model-controller-7998c67dc4-9x8lq"
Sep 11 17:51:41.546828 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:41.546807    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11cb31a3-3a26-4914-ad94-3e265a921326-cert\") pod \"odh-model-controller-7998c67dc4-9x8lq\" (UID: \"11cb31a3-3a26-4914-ad94-3e265a921326\") " pod="opendatahub/odh-model-controller-7998c67dc4-9x8lq"
Sep 11 17:51:41.550693 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:41.550498    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt" podStartSLOduration=2.102994372 podStartE2EDuration="4.550478969s" totalImagesPullingTime="2.447484597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:51:41.293145663 +0000 UTC m=+394.219097410" watchObservedRunningTime="2026-09-11 17:51:41.550478969 +0000 UTC m=+394.476430718"
Sep 11 17:51:41.552396 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:41.552377    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pn8tm"]
Sep 11 17:51:41.555062 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:51:41.555033    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca19e07_7926_4de6_afcd_6e314a975d44.slice/crio-bd41c0da4867270c1b853f0f7411500c3bb35821d8a96045762ca21d0ace6d5d WatchSource:0}: Error finding container bd41c0da4867270c1b853f0f7411500c3bb35821d8a96045762ca21d0ace6d5d: Status 404 returned error can't find the container with id bd41c0da4867270c1b853f0f7411500c3bb35821d8a96045762ca21d0ace6d5d
Sep 11 17:51:41.653454 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:41.653402    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9x8lq"
Sep 11 17:51:41.827433 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:41.827345    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:41.831968 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:41.831942    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:41.934121 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:41.934057    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9x8lq"]
Sep 11 17:51:41.936102 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:51:41.936076    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11cb31a3_3a26_4914_ad94_3e265a921326.slice/crio-504591eb1e89a0f7f4bef9b4b60e2503e15eefdf394b48fff8c65f891456fda9 WatchSource:0}: Error finding container 504591eb1e89a0f7f4bef9b4b60e2503e15eefdf394b48fff8c65f891456fda9: Status 404 returned error can't find the container with id 504591eb1e89a0f7f4bef9b4b60e2503e15eefdf394b48fff8c65f891456fda9
Sep 11 17:51:42.275879 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:42.275597    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9x8lq" event={"ID":"11cb31a3-3a26-4914-ad94-3e265a921326","Type":"ContainerStarted","Data":"504591eb1e89a0f7f4bef9b4b60e2503e15eefdf394b48fff8c65f891456fda9"}
Sep 11 17:51:42.277390 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:42.277359    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pn8tm" event={"ID":"2ca19e07-7926-4de6-afcd-6e314a975d44","Type":"ContainerStarted","Data":"bd41c0da4867270c1b853f0f7411500c3bb35821d8a96045762ca21d0ace6d5d"}
Sep 11 17:51:42.277675 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:42.277656    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:42.279063 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:42.279045    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt"
Sep 11 17:51:46.033164 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.033127    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b6858967-hbxmk"]
Sep 11 17:51:46.036401 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.036383    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:46.044044 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:46.044017    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"console-serving-cert\" is forbidden: User \"system:node:ip-10-0-140-211.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-140-211.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"console-serving-cert\"" type="*v1.Secret"
Sep 11 17:51:46.044822 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:46.044801    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"service-ca\" is forbidden: User \"system:node:ip-10-0-140-211.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-140-211.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"service-ca\"" type="*v1.ConfigMap"
Sep 11 17:51:46.044999 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:46.044976    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"console-oauth-config\" is forbidden: User \"system:node:ip-10-0-140-211.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-140-211.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"console-oauth-config\"" type="*v1.Secret"
Sep 11 17:51:46.045109 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:46.045088    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"console-dockercfg-mm5sn\" is forbidden: User \"system:node:ip-10-0-140-211.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-140-211.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"console-dockercfg-mm5sn\"" type="*v1.Secret"
Sep 11 17:51:46.045218 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:46.045160    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"console-config\" is forbidden: User \"system:node:ip-10-0-140-211.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-140-211.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"console-config\"" type="*v1.ConfigMap"
Sep 11 17:51:46.045270 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:46.045228    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-211.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-140-211.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 11 17:51:46.045270 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:46.045230    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"console-6b6858967-hbxmk\" is forbidden: User \"system:node:ip-10-0-140-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-140-211.ec2.internal' and this object" podUID="efaced64-c8c7-48b8-b7e3-960612195e83" pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:46.045340 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:46.045276    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"trusted-ca-bundle\" is forbidden: User \"system:node:ip-10-0-140-211.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-140-211.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" type="*v1.ConfigMap"
Sep 11 17:51:46.045904 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:46.045879    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-211.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-140-211.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 11 17:51:46.048138 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:46.048113    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"oauth-serving-cert\" is forbidden: User \"system:node:ip-10-0-140-211.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-140-211.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" type="*v1.ConfigMap"
Sep 11 17:51:46.138694 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.138655    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6858967-hbxmk"]
Sep 11 17:51:46.189849 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.189809    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbg65\" (UniqueName: \"kubernetes.io/projected/efaced64-c8c7-48b8-b7e3-960612195e83-kube-api-access-zbg65\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:46.190017 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.189873    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efaced64-c8c7-48b8-b7e3-960612195e83-console-config\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:46.190017 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.189954    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efaced64-c8c7-48b8-b7e3-960612195e83-oauth-serving-cert\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:46.190157 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.190052    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efaced64-c8c7-48b8-b7e3-960612195e83-service-ca\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:46.190157 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.190083    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efaced64-c8c7-48b8-b7e3-960612195e83-trusted-ca-bundle\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:46.190157 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.190112    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efaced64-c8c7-48b8-b7e3-960612195e83-console-serving-cert\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:46.190313 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.190192    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efaced64-c8c7-48b8-b7e3-960612195e83-console-oauth-config\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:46.291114 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.291026    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efaced64-c8c7-48b8-b7e3-960612195e83-service-ca\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:46.291114 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.291067    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efaced64-c8c7-48b8-b7e3-960612195e83-trusted-ca-bundle\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:46.291114 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.291094    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efaced64-c8c7-48b8-b7e3-960612195e83-console-serving-cert\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:46.291376 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.291140    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efaced64-c8c7-48b8-b7e3-960612195e83-console-oauth-config\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:46.291376 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.291172    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbg65\" (UniqueName: \"kubernetes.io/projected/efaced64-c8c7-48b8-b7e3-960612195e83-kube-api-access-zbg65\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:46.291376 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.291207    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efaced64-c8c7-48b8-b7e3-960612195e83-console-config\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:46.291376 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.291242    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efaced64-c8c7-48b8-b7e3-960612195e83-oauth-serving-cert\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:46.299523 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.299485    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9x8lq" event={"ID":"11cb31a3-3a26-4914-ad94-3e265a921326","Type":"ContainerStarted","Data":"41c6b37362f2b3b41878e6b806988c34a7487f44163695e39ff39cefc9027117"}
Sep 11 17:51:46.299680 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.299594    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9x8lq"
Sep 11 17:51:46.301059 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.301038    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pn8tm" event={"ID":"2ca19e07-7926-4de6-afcd-6e314a975d44","Type":"ContainerStarted","Data":"1103795e0defce15fe6cc0104214bbe5c8cbd30520a2a086a99539a579a31961"}
Sep 11 17:51:46.301144 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.301083    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-pn8tm"
Sep 11 17:51:46.430033 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.429974    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9x8lq" podStartSLOduration=3.998504064 podStartE2EDuration="7.429958464s" totalImagesPullingTime="3.4314544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:51:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:51:46.42882107 +0000 UTC m=+399.354772818" watchObservedRunningTime="2026-09-11 17:51:46.429958464 +0000 UTC m=+399.355910210"
Sep 11 17:51:46.863478 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.863448    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 17:51:46.874520 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.874488    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efaced64-c8c7-48b8-b7e3-960612195e83-console-oauth-config\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:46.881904 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.881877    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 17:51:46.892424 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:46.892392    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efaced64-c8c7-48b8-b7e3-960612195e83-oauth-serving-cert\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:47.041704 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:47.041619    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 17:51:47.291815 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:47.291705    2579 secret.go:189] Couldn't get secret openshift-console/console-serving-cert: failed to sync secret cache: timed out waiting for the condition
Sep 11 17:51:47.291815 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:47.291743    2579 configmap.go:193] Couldn't get configMap openshift-console/console-config: failed to sync configmap cache: timed out waiting for the condition
Sep 11 17:51:47.291815 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:47.291706    2579 configmap.go:193] Couldn't get configMap openshift-console/service-ca: failed to sync configmap cache: timed out waiting for the condition
Sep 11 17:51:47.292084 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:47.291827    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efaced64-c8c7-48b8-b7e3-960612195e83-console-serving-cert podName:efaced64-c8c7-48b8-b7e3-960612195e83 nodeName:}" failed. No retries permitted until 2026-09-11 17:51:47.791806763 +0000 UTC m=+400.717758492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "console-serving-cert" (UniqueName: "kubernetes.io/secret/efaced64-c8c7-48b8-b7e3-960612195e83-console-serving-cert") pod "console-6b6858967-hbxmk" (UID: "efaced64-c8c7-48b8-b7e3-960612195e83") : failed to sync secret cache: timed out waiting for the condition
Sep 11 17:51:47.292084 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:47.291849    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/efaced64-c8c7-48b8-b7e3-960612195e83-console-config podName:efaced64-c8c7-48b8-b7e3-960612195e83 nodeName:}" failed. No retries permitted until 2026-09-11 17:51:47.791840019 +0000 UTC m=+400.717791743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/efaced64-c8c7-48b8-b7e3-960612195e83-console-config") pod "console-6b6858967-hbxmk" (UID: "efaced64-c8c7-48b8-b7e3-960612195e83") : failed to sync configmap cache: timed out waiting for the condition
Sep 11 17:51:47.292084 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:47.291870    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/efaced64-c8c7-48b8-b7e3-960612195e83-service-ca podName:efaced64-c8c7-48b8-b7e3-960612195e83 nodeName:}" failed. No retries permitted until 2026-09-11 17:51:47.79185567 +0000 UTC m=+400.717807399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca" (UniqueName: "kubernetes.io/configmap/efaced64-c8c7-48b8-b7e3-960612195e83-service-ca") pod "console-6b6858967-hbxmk" (UID: "efaced64-c8c7-48b8-b7e3-960612195e83") : failed to sync configmap cache: timed out waiting for the condition
Sep 11 17:51:47.292084 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:47.291713    2579 configmap.go:193] Couldn't get configMap openshift-console/trusted-ca-bundle: failed to sync configmap cache: timed out waiting for the condition
Sep 11 17:51:47.292084 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:47.291898    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/efaced64-c8c7-48b8-b7e3-960612195e83-trusted-ca-bundle podName:efaced64-c8c7-48b8-b7e3-960612195e83 nodeName:}" failed. No retries permitted until 2026-09-11 17:51:47.791891146 +0000 UTC m=+400.717842871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/efaced64-c8c7-48b8-b7e3-960612195e83-trusted-ca-bundle") pod "console-6b6858967-hbxmk" (UID: "efaced64-c8c7-48b8-b7e3-960612195e83") : failed to sync configmap cache: timed out waiting for the condition
Sep 11 17:51:47.304226 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:47.304196    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 17:51:47.344200 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:47.344156    2579 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Sep 11 17:51:47.344200 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:47.344203    2579 projected.go:196] Error preparing data for projected volume kube-api-access-zbg65 for pod openshift-console/console-6b6858967-hbxmk: failed to sync configmap cache: timed out waiting for the condition
Sep 11 17:51:47.344393 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:51:47.344268    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efaced64-c8c7-48b8-b7e3-960612195e83-kube-api-access-zbg65 podName:efaced64-c8c7-48b8-b7e3-960612195e83 nodeName:}" failed. No retries permitted until 2026-09-11 17:51:47.844249685 +0000 UTC m=+400.770201415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zbg65" (UniqueName: "kubernetes.io/projected/efaced64-c8c7-48b8-b7e3-960612195e83-kube-api-access-zbg65") pod "console-6b6858967-hbxmk" (UID: "efaced64-c8c7-48b8-b7e3-960612195e83") : failed to sync configmap cache: timed out waiting for the condition
Sep 11 17:51:47.466538 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:47.466493    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 17:51:47.574913 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:47.574823    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 17:51:47.589367 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:47.589325    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 17:51:47.603004 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:47.602972    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 17:51:47.626484 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:47.626455    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mm5sn\""
Sep 11 17:51:47.802584 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:47.802544    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efaced64-c8c7-48b8-b7e3-960612195e83-console-config\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:47.802738 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:47.802643    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efaced64-c8c7-48b8-b7e3-960612195e83-service-ca\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:47.802738 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:47.802674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efaced64-c8c7-48b8-b7e3-960612195e83-trusted-ca-bundle\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:47.802738 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:47.802702    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efaced64-c8c7-48b8-b7e3-960612195e83-console-serving-cert\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:47.803217 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:47.803191    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efaced64-c8c7-48b8-b7e3-960612195e83-console-config\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:47.803509 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:47.803488    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efaced64-c8c7-48b8-b7e3-960612195e83-trusted-ca-bundle\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:47.803586 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:47.803536    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efaced64-c8c7-48b8-b7e3-960612195e83-service-ca\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:47.805164 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:47.805142    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efaced64-c8c7-48b8-b7e3-960612195e83-console-serving-cert\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:47.904137 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:47.904044    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbg65\" (UniqueName: \"kubernetes.io/projected/efaced64-c8c7-48b8-b7e3-960612195e83-kube-api-access-zbg65\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:47.906606 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:47.906575    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbg65\" (UniqueName: \"kubernetes.io/projected/efaced64-c8c7-48b8-b7e3-960612195e83-kube-api-access-zbg65\") pod \"console-6b6858967-hbxmk\" (UID: \"efaced64-c8c7-48b8-b7e3-960612195e83\") " pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:48.146030 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:48.145988    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:48.437844 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:48.437709    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-pn8tm" podStartSLOduration=4.67488195 podStartE2EDuration="8.437690748s" totalImagesPullingTime="3.762808798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:51:46.537434665 +0000 UTC m=+399.463386411" watchObservedRunningTime="2026-09-11 17:51:48.437690748 +0000 UTC m=+401.363642522"
Sep 11 17:51:48.438790 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:48.438747    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6858967-hbxmk"]
Sep 11 17:51:48.441842 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:51:48.441815    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefaced64_c8c7_48b8_b7e3_960612195e83.slice/crio-24c7351019329bc6697711d33819d4d0e5a720f7e8b65589608231f57c08a0ac WatchSource:0}: Error finding container 24c7351019329bc6697711d33819d4d0e5a720f7e8b65589608231f57c08a0ac: Status 404 returned error can't find the container with id 24c7351019329bc6697711d33819d4d0e5a720f7e8b65589608231f57c08a0ac
Sep 11 17:51:49.317372 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:49.317330    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6858967-hbxmk" event={"ID":"efaced64-c8c7-48b8-b7e3-960612195e83","Type":"ContainerStarted","Data":"e40f31dcebcf8aaaa3e801945598f8c24dfbeddb80b85ba487e94f04d2801340"}
Sep 11 17:51:49.317754 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:49.317390    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6858967-hbxmk" event={"ID":"efaced64-c8c7-48b8-b7e3-960612195e83","Type":"ContainerStarted","Data":"24c7351019329bc6697711d33819d4d0e5a720f7e8b65589608231f57c08a0ac"}
Sep 11 17:51:52.697079 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:52.697018    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b6858967-hbxmk" podStartSLOduration=7.69700011 podStartE2EDuration="7.69700011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:51:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:51:52.687852861 +0000 UTC m=+405.613804599" watchObservedRunningTime="2026-09-11 17:51:52.69700011 +0000 UTC m=+405.622951855"
Sep 11 17:51:54.318982 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.318947    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6d9x7"]
Sep 11 17:51:54.322548 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.322530    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6d9x7"
Sep 11 17:51:54.338093 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.338069    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 11 17:51:54.338242 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.338225    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8h6d5\""
Sep 11 17:51:54.357173 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.357145    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-pjlwk"]
Sep 11 17:51:54.360621 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.360604    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pjlwk"
Sep 11 17:51:54.365347 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.365183    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 11 17:51:54.365921 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.365724    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-cvxjx\""
Sep 11 17:51:54.429841 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.429802    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6d9x7"]
Sep 11 17:51:54.458847 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.458812    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5dc7125d-0734-414b-ab41-15bd9664440b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-pjlwk\" (UID: \"5dc7125d-0734-414b-ab41-15bd9664440b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pjlwk"
Sep 11 17:51:54.459013 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.458859    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9bnp\" (UniqueName: \"kubernetes.io/projected/5dc7125d-0734-414b-ab41-15bd9664440b-kube-api-access-l9bnp\") pod \"llmisvc-controller-manager-777c6bd7d5-pjlwk\" (UID: \"5dc7125d-0734-414b-ab41-15bd9664440b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pjlwk"
Sep 11 17:51:54.459013 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.458967    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d05abf5-3dec-4787-8f04-1d4c88531564-cert\") pod \"kserve-controller-manager-d6f4b65b8-6d9x7\" (UID: \"0d05abf5-3dec-4787-8f04-1d4c88531564\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6d9x7"
Sep 11 17:51:54.459013 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.459004    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2k7b\" (UniqueName: \"kubernetes.io/projected/0d05abf5-3dec-4787-8f04-1d4c88531564-kube-api-access-h2k7b\") pod \"kserve-controller-manager-d6f4b65b8-6d9x7\" (UID: \"0d05abf5-3dec-4787-8f04-1d4c88531564\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6d9x7"
Sep 11 17:51:54.460748 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.460728    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-pjlwk"]
Sep 11 17:51:54.559483 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.559448    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d05abf5-3dec-4787-8f04-1d4c88531564-cert\") pod \"kserve-controller-manager-d6f4b65b8-6d9x7\" (UID: \"0d05abf5-3dec-4787-8f04-1d4c88531564\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6d9x7"
Sep 11 17:51:54.559483 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.559487    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2k7b\" (UniqueName: \"kubernetes.io/projected/0d05abf5-3dec-4787-8f04-1d4c88531564-kube-api-access-h2k7b\") pod \"kserve-controller-manager-d6f4b65b8-6d9x7\" (UID: \"0d05abf5-3dec-4787-8f04-1d4c88531564\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6d9x7"
Sep 11 17:51:54.559689 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.559540    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5dc7125d-0734-414b-ab41-15bd9664440b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-pjlwk\" (UID: \"5dc7125d-0734-414b-ab41-15bd9664440b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pjlwk"
Sep 11 17:51:54.559689 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.559561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9bnp\" (UniqueName: \"kubernetes.io/projected/5dc7125d-0734-414b-ab41-15bd9664440b-kube-api-access-l9bnp\") pod \"llmisvc-controller-manager-777c6bd7d5-pjlwk\" (UID: \"5dc7125d-0734-414b-ab41-15bd9664440b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pjlwk"
Sep 11 17:51:54.561917 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.561892    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5dc7125d-0734-414b-ab41-15bd9664440b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-pjlwk\" (UID: \"5dc7125d-0734-414b-ab41-15bd9664440b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pjlwk"
Sep 11 17:51:54.562190 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.562170    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d05abf5-3dec-4787-8f04-1d4c88531564-cert\") pod \"kserve-controller-manager-d6f4b65b8-6d9x7\" (UID: \"0d05abf5-3dec-4787-8f04-1d4c88531564\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6d9x7"
Sep 11 17:51:54.577035 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.576975    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2k7b\" (UniqueName: \"kubernetes.io/projected/0d05abf5-3dec-4787-8f04-1d4c88531564-kube-api-access-h2k7b\") pod \"kserve-controller-manager-d6f4b65b8-6d9x7\" (UID: \"0d05abf5-3dec-4787-8f04-1d4c88531564\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6d9x7"
Sep 11 17:51:54.580368 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.580343    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9bnp\" (UniqueName: \"kubernetes.io/projected/5dc7125d-0734-414b-ab41-15bd9664440b-kube-api-access-l9bnp\") pod \"llmisvc-controller-manager-777c6bd7d5-pjlwk\" (UID: \"5dc7125d-0734-414b-ab41-15bd9664440b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pjlwk"
Sep 11 17:51:54.633203 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.633166    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6d9x7"
Sep 11 17:51:54.671359 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.671287    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pjlwk"
Sep 11 17:51:54.969249 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:54.969159    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6d9x7"]
Sep 11 17:51:55.052026 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:51:55.051999    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d05abf5_3dec_4787_8f04_1d4c88531564.slice/crio-e8af2abf8748253dd23743799b320cf71861c0037b38458b6ea2bba71ec1cff2 WatchSource:0}: Error finding container e8af2abf8748253dd23743799b320cf71861c0037b38458b6ea2bba71ec1cff2: Status 404 returned error can't find the container with id e8af2abf8748253dd23743799b320cf71861c0037b38458b6ea2bba71ec1cff2
Sep 11 17:51:55.117499 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:55.117386    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-pjlwk"]
Sep 11 17:51:55.118614 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:51:55.118592    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5dc7125d_0734_414b_ab41_15bd9664440b.slice/crio-fe1e3d60acdade044b0cd754e9e6925dce5aa8a978ffc4bcdd123bfb0a8c0b45 WatchSource:0}: Error finding container fe1e3d60acdade044b0cd754e9e6925dce5aa8a978ffc4bcdd123bfb0a8c0b45: Status 404 returned error can't find the container with id fe1e3d60acdade044b0cd754e9e6925dce5aa8a978ffc4bcdd123bfb0a8c0b45
Sep 11 17:51:55.352292 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:55.352253    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pjlwk" event={"ID":"5dc7125d-0734-414b-ab41-15bd9664440b","Type":"ContainerStarted","Data":"fe1e3d60acdade044b0cd754e9e6925dce5aa8a978ffc4bcdd123bfb0a8c0b45"}
Sep 11 17:51:55.353571 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:55.353543    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6d9x7" event={"ID":"0d05abf5-3dec-4787-8f04-1d4c88531564","Type":"ContainerStarted","Data":"e8af2abf8748253dd23743799b320cf71861c0037b38458b6ea2bba71ec1cff2"}
Sep 11 17:51:57.309793 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:57.309646    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9x8lq"
Sep 11 17:51:57.312281 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:57.312257    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-pn8tm"
Sep 11 17:51:58.146582 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:58.146555    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:58.146738 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:58.146629    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:58.151286 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:58.151263    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:58.374903 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:58.374803    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pjlwk" event={"ID":"5dc7125d-0734-414b-ab41-15bd9664440b","Type":"ContainerStarted","Data":"6596217810eaa826487e4e3827812f04ce7e630111dea6e2cb9c621460bb18af"}
Sep 11 17:51:58.374903 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:58.374895    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pjlwk"
Sep 11 17:51:58.376615 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:58.376587    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6d9x7" event={"ID":"0d05abf5-3dec-4787-8f04-1d4c88531564","Type":"ContainerStarted","Data":"3a1594ece7c44b4452a6f4baaa1419333d02f42e4f6e5354d188b7188a1dde11"}
Sep 11 17:51:58.376786 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:58.376769    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6d9x7"
Sep 11 17:51:58.380711 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:58.380690    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b6858967-hbxmk"
Sep 11 17:51:58.420171 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:58.420124    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pjlwk" podStartSLOduration=1.507272007 podStartE2EDuration="4.420108104s" totalImagesPullingTime="2.912836097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:51:58.41897732 +0000 UTC m=+411.344929065" watchObservedRunningTime="2026-09-11 17:51:58.420108104 +0000 UTC m=+411.346059849"
Sep 11 17:51:58.590798 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:51:58.590684    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6d9x7" podStartSLOduration=1.614656744 podStartE2EDuration="4.590663625s" totalImagesPullingTime="2.976006881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:51:58.589712501 +0000 UTC m=+411.515664249" watchObservedRunningTime="2026-09-11 17:51:58.590663625 +0000 UTC m=+411.516615371"
Sep 11 17:52:29.383583 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:52:29.383546    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pjlwk"
Sep 11 17:52:29.387003 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:52:29.386982    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6d9x7"
Sep 11 17:53:11.614247 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:11.614209    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-c9vt4"]
Sep 11 17:53:11.617538 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:11.617520    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-c9vt4"
Sep 11 17:53:11.625541 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:11.625526    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 17:53:11.625629 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:11.625525    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 17:53:11.626106 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:11.626092    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gjzjr\""
Sep 11 17:53:11.647756 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:11.647728    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-c9vt4"]
Sep 11 17:53:11.753467 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:11.753433    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zss2\" (UniqueName: \"kubernetes.io/projected/e98ae1f1-0536-4a1e-ba51-83620c8f8b76-kube-api-access-4zss2\") pod \"limitador-operator-controller-manager-74495c69f8-c9vt4\" (UID: \"e98ae1f1-0536-4a1e-ba51-83620c8f8b76\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-c9vt4"
Sep 11 17:53:11.854168 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:11.854128    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zss2\" (UniqueName: \"kubernetes.io/projected/e98ae1f1-0536-4a1e-ba51-83620c8f8b76-kube-api-access-4zss2\") pod \"limitador-operator-controller-manager-74495c69f8-c9vt4\" (UID: \"e98ae1f1-0536-4a1e-ba51-83620c8f8b76\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-c9vt4"
Sep 11 17:53:11.873302 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:11.873231    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zss2\" (UniqueName: \"kubernetes.io/projected/e98ae1f1-0536-4a1e-ba51-83620c8f8b76-kube-api-access-4zss2\") pod \"limitador-operator-controller-manager-74495c69f8-c9vt4\" (UID: \"e98ae1f1-0536-4a1e-ba51-83620c8f8b76\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-c9vt4"
Sep 11 17:53:11.927286 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:11.927245    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-c9vt4"
Sep 11 17:53:12.295507 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:12.295482    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-c9vt4"]
Sep 11 17:53:12.298310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:53:12.298284    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode98ae1f1_0536_4a1e_ba51_83620c8f8b76.slice/crio-8ad66441dc459274c3658f5a11d1f58edf92dfa0017c66fe81186817d6d0b423 WatchSource:0}: Error finding container 8ad66441dc459274c3658f5a11d1f58edf92dfa0017c66fe81186817d6d0b423: Status 404 returned error can't find the container with id 8ad66441dc459274c3658f5a11d1f58edf92dfa0017c66fe81186817d6d0b423
Sep 11 17:53:12.731466 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:12.731372    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-c9vt4" event={"ID":"e98ae1f1-0536-4a1e-ba51-83620c8f8b76","Type":"ContainerStarted","Data":"8ad66441dc459274c3658f5a11d1f58edf92dfa0017c66fe81186817d6d0b423"}
Sep 11 17:53:15.747708 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:15.747675    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-c9vt4" event={"ID":"e98ae1f1-0536-4a1e-ba51-83620c8f8b76","Type":"ContainerStarted","Data":"3c9b6ddd78e52eb2dbbfa54515d5e113e7b5cf1c20a464d688697cbb28ba8511"}
Sep 11 17:53:15.748103 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:15.747782    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-c9vt4"
Sep 11 17:53:15.796459 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:15.796409    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-c9vt4" podStartSLOduration=2.2964136760000002 podStartE2EDuration="4.796391566s" totalImagesPullingTime="2.49997789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:53:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:53:15.79531061 +0000 UTC m=+488.721262356" watchObservedRunningTime="2026-09-11 17:53:15.796391566 +0000 UTC m=+488.722343312"
Sep 11 17:53:22.904817 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:22.904776    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-c9vt4"]
Sep 11 17:53:22.905278 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:22.905035    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-c9vt4" podUID="e98ae1f1-0536-4a1e-ba51-83620c8f8b76" containerName="manager" containerID="cri-o://3c9b6ddd78e52eb2dbbfa54515d5e113e7b5cf1c20a464d688697cbb28ba8511" gracePeriod=2
Sep 11 17:53:22.906995 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:22.906971    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-c9vt4"]
Sep 11 17:53:22.923127 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:53:22.923078    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-c9vt4\" is forbidden: User \"system:node:ip-10-0-140-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-211.ec2.internal' and this object" podUID="e98ae1f1-0536-4a1e-ba51-83620c8f8b76" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-c9vt4"
Sep 11 17:53:23.054584 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.054550    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-bhv4t"]
Sep 11 17:53:23.055044 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.055025    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e98ae1f1-0536-4a1e-ba51-83620c8f8b76" containerName="manager"
Sep 11 17:53:23.055153 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.055046    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e98ae1f1-0536-4a1e-ba51-83620c8f8b76" containerName="manager"
Sep 11 17:53:23.055153 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.055136    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e98ae1f1-0536-4a1e-ba51-83620c8f8b76" containerName="manager"
Sep 11 17:53:23.058158 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.058137    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bhv4t"
Sep 11 17:53:23.154933 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.154873    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-c9vt4"
Sep 11 17:53:23.155263 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.155244    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ktkd\" (UniqueName: \"kubernetes.io/projected/7f5364b9-72d5-4b62-b090-11b1da53bcaa-kube-api-access-4ktkd\") pod \"limitador-operator-controller-manager-74495c69f8-bhv4t\" (UID: \"7f5364b9-72d5-4b62-b090-11b1da53bcaa\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bhv4t"
Sep 11 17:53:23.193579 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.193541    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-bhv4t"]
Sep 11 17:53:23.256004 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.255972    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zss2\" (UniqueName: \"kubernetes.io/projected/e98ae1f1-0536-4a1e-ba51-83620c8f8b76-kube-api-access-4zss2\") pod \"e98ae1f1-0536-4a1e-ba51-83620c8f8b76\" (UID: \"e98ae1f1-0536-4a1e-ba51-83620c8f8b76\") "
Sep 11 17:53:23.256175 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.256153    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ktkd\" (UniqueName: \"kubernetes.io/projected/7f5364b9-72d5-4b62-b090-11b1da53bcaa-kube-api-access-4ktkd\") pod \"limitador-operator-controller-manager-74495c69f8-bhv4t\" (UID: \"7f5364b9-72d5-4b62-b090-11b1da53bcaa\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bhv4t"
Sep 11 17:53:23.258124 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.258091    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e98ae1f1-0536-4a1e-ba51-83620c8f8b76-kube-api-access-4zss2" (OuterVolumeSpecName: "kube-api-access-4zss2") pod "e98ae1f1-0536-4a1e-ba51-83620c8f8b76" (UID: "e98ae1f1-0536-4a1e-ba51-83620c8f8b76"). InnerVolumeSpecName "kube-api-access-4zss2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:53:23.288198 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.288168    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ktkd\" (UniqueName: \"kubernetes.io/projected/7f5364b9-72d5-4b62-b090-11b1da53bcaa-kube-api-access-4ktkd\") pod \"limitador-operator-controller-manager-74495c69f8-bhv4t\" (UID: \"7f5364b9-72d5-4b62-b090-11b1da53bcaa\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bhv4t"
Sep 11 17:53:23.357592 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.357559    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zss2\" (UniqueName: \"kubernetes.io/projected/e98ae1f1-0536-4a1e-ba51-83620c8f8b76-kube-api-access-4zss2\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:53:23.358218 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:53:23.358190    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-c9vt4\" is forbidden: User \"system:node:ip-10-0-140-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-211.ec2.internal' and this object" podUID="e98ae1f1-0536-4a1e-ba51-83620c8f8b76" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-c9vt4"
Sep 11 17:53:23.361133 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:53:23.361111    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-c9vt4\" is forbidden: User \"system:node:ip-10-0-140-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-211.ec2.internal' and this object" podUID="e98ae1f1-0536-4a1e-ba51-83620c8f8b76" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-c9vt4"
Sep 11 17:53:23.367241 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.367208    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bhv4t"
Sep 11 17:53:23.534304 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.534273    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e98ae1f1-0536-4a1e-ba51-83620c8f8b76" path="/var/lib/kubelet/pods/e98ae1f1-0536-4a1e-ba51-83620c8f8b76/volumes"
Sep 11 17:53:23.740505 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:53:23.740476    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5364b9_72d5_4b62_b090_11b1da53bcaa.slice/crio-e33f5522bbf56efbb9245a72c7c74f8afece9fa1c6f137c5e1d418ead6cb6d6b WatchSource:0}: Error finding container e33f5522bbf56efbb9245a72c7c74f8afece9fa1c6f137c5e1d418ead6cb6d6b: Status 404 returned error can't find the container with id e33f5522bbf56efbb9245a72c7c74f8afece9fa1c6f137c5e1d418ead6cb6d6b
Sep 11 17:53:23.750950 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.750927    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-bhv4t"]
Sep 11 17:53:23.788493 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.788466    2579 generic.go:356] "Generic (PLEG): container finished" podID="e98ae1f1-0536-4a1e-ba51-83620c8f8b76" containerID="3c9b6ddd78e52eb2dbbfa54515d5e113e7b5cf1c20a464d688697cbb28ba8511" exitCode=0
Sep 11 17:53:23.788617 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.788503    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-c9vt4"
Sep 11 17:53:23.788617 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.788557    2579 scope.go:117] "RemoveContainer" containerID="3c9b6ddd78e52eb2dbbfa54515d5e113e7b5cf1c20a464d688697cbb28ba8511"
Sep 11 17:53:23.790320 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.790283    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bhv4t" event={"ID":"7f5364b9-72d5-4b62-b090-11b1da53bcaa","Type":"ContainerStarted","Data":"e33f5522bbf56efbb9245a72c7c74f8afece9fa1c6f137c5e1d418ead6cb6d6b"}
Sep 11 17:53:23.797006 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.796988    2579 scope.go:117] "RemoveContainer" containerID="3c9b6ddd78e52eb2dbbfa54515d5e113e7b5cf1c20a464d688697cbb28ba8511"
Sep 11 17:53:23.797249 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:53:23.797228    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c9b6ddd78e52eb2dbbfa54515d5e113e7b5cf1c20a464d688697cbb28ba8511\": container with ID starting with 3c9b6ddd78e52eb2dbbfa54515d5e113e7b5cf1c20a464d688697cbb28ba8511 not found: ID does not exist" containerID="3c9b6ddd78e52eb2dbbfa54515d5e113e7b5cf1c20a464d688697cbb28ba8511"
Sep 11 17:53:23.797309 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:23.797256    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c9b6ddd78e52eb2dbbfa54515d5e113e7b5cf1c20a464d688697cbb28ba8511"} err="failed to get container status \"3c9b6ddd78e52eb2dbbfa54515d5e113e7b5cf1c20a464d688697cbb28ba8511\": rpc error: code = NotFound desc = could not find container \"3c9b6ddd78e52eb2dbbfa54515d5e113e7b5cf1c20a464d688697cbb28ba8511\": container with ID starting with 3c9b6ddd78e52eb2dbbfa54515d5e113e7b5cf1c20a464d688697cbb28ba8511 not found: ID does not exist"
Sep 11 17:53:24.798132 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:24.798098    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bhv4t" event={"ID":"7f5364b9-72d5-4b62-b090-11b1da53bcaa","Type":"ContainerStarted","Data":"1dec600acd9d6a936f7166d1a09bbf7a735bad32a689951b0894432f66dcd084"}
Sep 11 17:53:24.798536 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:24.798173    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bhv4t"
Sep 11 17:53:24.866530 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:24.866482    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bhv4t" podStartSLOduration=2.866463927 podStartE2EDuration="2.866463927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:53:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:53:24.862799334 +0000 UTC m=+497.788751070" watchObservedRunningTime="2026-09-11 17:53:24.866463927 +0000 UTC m=+497.792415672"
Sep 11 17:53:35.805256 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:35.805223    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bhv4t"
Sep 11 17:53:58.273548 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.273505    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"]
Sep 11 17:53:58.278938 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.278917    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.285617 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.285595    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-22kr7\""
Sep 11 17:53:58.304247 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.304217    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"]
Sep 11 17:53:58.358393 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.358362    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15a0c1fc-f412-439b-993d-b4d4008122a2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.358393 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.358394    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15a0c1fc-f412-439b-993d-b4d4008122a2-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.358572 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.358417    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8z29\" (UniqueName: \"kubernetes.io/projected/15a0c1fc-f412-439b-993d-b4d4008122a2-kube-api-access-t8z29\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.358572 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.358488    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15a0c1fc-f412-439b-993d-b4d4008122a2-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.358572 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.358510    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15a0c1fc-f412-439b-993d-b4d4008122a2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.358667 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.358595    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a0c1fc-f412-439b-993d-b4d4008122a2-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.358667 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.358647    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a0c1fc-f412-439b-993d-b4d4008122a2-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.358731 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.358686    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15a0c1fc-f412-439b-993d-b4d4008122a2-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.358731 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.358713    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15a0c1fc-f412-439b-993d-b4d4008122a2-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.459826 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.459790    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15a0c1fc-f412-439b-993d-b4d4008122a2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.459999 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.459850    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a0c1fc-f412-439b-993d-b4d4008122a2-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.459999 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.459898    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a0c1fc-f412-439b-993d-b4d4008122a2-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.459999 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.459935    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15a0c1fc-f412-439b-993d-b4d4008122a2-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.459999 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.459982    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15a0c1fc-f412-439b-993d-b4d4008122a2-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.460292 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.460042    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15a0c1fc-f412-439b-993d-b4d4008122a2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.460292 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.460071    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15a0c1fc-f412-439b-993d-b4d4008122a2-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.460292 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.460107    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8z29\" (UniqueName: \"kubernetes.io/projected/15a0c1fc-f412-439b-993d-b4d4008122a2-kube-api-access-t8z29\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.460292 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.460142    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15a0c1fc-f412-439b-993d-b4d4008122a2-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.460489 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.460327    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a0c1fc-f412-439b-993d-b4d4008122a2-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.461039 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.460596    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15a0c1fc-f412-439b-993d-b4d4008122a2-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.461039 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.460885    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15a0c1fc-f412-439b-993d-b4d4008122a2-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.461039 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.461002    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15a0c1fc-f412-439b-993d-b4d4008122a2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.461315 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.461262    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a0c1fc-f412-439b-993d-b4d4008122a2-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.463626 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.463368    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15a0c1fc-f412-439b-993d-b4d4008122a2-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.463626 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.463571    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15a0c1fc-f412-439b-993d-b4d4008122a2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.474292 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.474264    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15a0c1fc-f412-439b-993d-b4d4008122a2-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.474662 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.474643    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8z29\" (UniqueName: \"kubernetes.io/projected/15a0c1fc-f412-439b-993d-b4d4008122a2-kube-api-access-t8z29\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9z8xb\" (UID: \"15a0c1fc-f412-439b-993d-b4d4008122a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.590135 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.590057    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:53:58.913385 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.913286    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"]
Sep 11 17:53:58.918423 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:53:58.918391    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a0c1fc_f412_439b_993d_b4d4008122a2.slice/crio-16d2965c99c5c927b15649c119e2e8b695eb3b4953b965276aeb62b11297327a WatchSource:0}: Error finding container 16d2965c99c5c927b15649c119e2e8b695eb3b4953b965276aeb62b11297327a: Status 404 returned error can't find the container with id 16d2965c99c5c927b15649c119e2e8b695eb3b4953b965276aeb62b11297327a
Sep 11 17:53:58.920480 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.920438    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:53:58.920567 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.920518    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:53:58.920567 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.920552    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:53:58.969949 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:58.969922    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb" event={"ID":"15a0c1fc-f412-439b-993d-b4d4008122a2","Type":"ContainerStarted","Data":"16d2965c99c5c927b15649c119e2e8b695eb3b4953b965276aeb62b11297327a"}
Sep 11 17:53:59.976699 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:53:59.976660    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb" event={"ID":"15a0c1fc-f412-439b-993d-b4d4008122a2","Type":"ContainerStarted","Data":"2ad8907beecb7cca6636630332e18d210d054b96375b6c4d9b7be7b2858c33b8"}
Sep 11 17:54:00.007282 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:00.007217    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb" podStartSLOduration=2.007196203 podStartE2EDuration="2.007196203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:53:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:54:00.0045812 +0000 UTC m=+532.930532981" watchObservedRunningTime="2026-09-11 17:54:00.007196203 +0000 UTC m=+532.933147951"
Sep 11 17:54:00.591233 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:00.591194    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:54:00.596332 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:00.596305    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:54:00.981263 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:00.981180    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:54:00.982297 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:00.982276    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:54:43.222987 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:43.222952    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c899f7bf-j4ltc"]
Sep 11 17:54:43.226623 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:43.226607    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c899f7bf-j4ltc"
Sep 11 17:54:43.235827 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:43.235796    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 17:54:43.235968 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:43.235930    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xn9bs\""
Sep 11 17:54:43.237248 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:43.237229    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 17:54:43.246882 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:43.246858    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 17:54:43.262431 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:43.262404    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c899f7bf-j4ltc"]
Sep 11 17:54:43.368931 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:43.368892    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkwjf\" (UniqueName: \"kubernetes.io/projected/97421a3d-5cdd-4019-9fb5-d0d66106d2a2-kube-api-access-jkwjf\") pod \"maas-controller-c899f7bf-j4ltc\" (UID: \"97421a3d-5cdd-4019-9fb5-d0d66106d2a2\") " pod="opendatahub/maas-controller-c899f7bf-j4ltc"
Sep 11 17:54:43.369133 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:43.368961    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97421a3d-5cdd-4019-9fb5-d0d66106d2a2-metrics-certs\") pod \"maas-controller-c899f7bf-j4ltc\" (UID: \"97421a3d-5cdd-4019-9fb5-d0d66106d2a2\") " pod="opendatahub/maas-controller-c899f7bf-j4ltc"
Sep 11 17:54:43.369133 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:43.369109    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97421a3d-5cdd-4019-9fb5-d0d66106d2a2-webhook-cert\") pod \"maas-controller-c899f7bf-j4ltc\" (UID: \"97421a3d-5cdd-4019-9fb5-d0d66106d2a2\") " pod="opendatahub/maas-controller-c899f7bf-j4ltc"
Sep 11 17:54:43.470543 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:43.470504    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97421a3d-5cdd-4019-9fb5-d0d66106d2a2-metrics-certs\") pod \"maas-controller-c899f7bf-j4ltc\" (UID: \"97421a3d-5cdd-4019-9fb5-d0d66106d2a2\") " pod="opendatahub/maas-controller-c899f7bf-j4ltc"
Sep 11 17:54:43.470721 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:43.470613    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97421a3d-5cdd-4019-9fb5-d0d66106d2a2-webhook-cert\") pod \"maas-controller-c899f7bf-j4ltc\" (UID: \"97421a3d-5cdd-4019-9fb5-d0d66106d2a2\") " pod="opendatahub/maas-controller-c899f7bf-j4ltc"
Sep 11 17:54:43.470721 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:43.470636    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkwjf\" (UniqueName: \"kubernetes.io/projected/97421a3d-5cdd-4019-9fb5-d0d66106d2a2-kube-api-access-jkwjf\") pod \"maas-controller-c899f7bf-j4ltc\" (UID: \"97421a3d-5cdd-4019-9fb5-d0d66106d2a2\") " pod="opendatahub/maas-controller-c899f7bf-j4ltc"
Sep 11 17:54:43.473087 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:43.473027    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97421a3d-5cdd-4019-9fb5-d0d66106d2a2-metrics-certs\") pod \"maas-controller-c899f7bf-j4ltc\" (UID: \"97421a3d-5cdd-4019-9fb5-d0d66106d2a2\") " pod="opendatahub/maas-controller-c899f7bf-j4ltc"
Sep 11 17:54:43.473087 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:43.473064    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97421a3d-5cdd-4019-9fb5-d0d66106d2a2-webhook-cert\") pod \"maas-controller-c899f7bf-j4ltc\" (UID: \"97421a3d-5cdd-4019-9fb5-d0d66106d2a2\") " pod="opendatahub/maas-controller-c899f7bf-j4ltc"
Sep 11 17:54:43.487271 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:43.487246    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkwjf\" (UniqueName: \"kubernetes.io/projected/97421a3d-5cdd-4019-9fb5-d0d66106d2a2-kube-api-access-jkwjf\") pod \"maas-controller-c899f7bf-j4ltc\" (UID: \"97421a3d-5cdd-4019-9fb5-d0d66106d2a2\") " pod="opendatahub/maas-controller-c899f7bf-j4ltc"
Sep 11 17:54:43.538966 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:43.538937    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c899f7bf-j4ltc"
Sep 11 17:54:43.823905 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:43.823873    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c899f7bf-j4ltc"]
Sep 11 17:54:43.827059 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:54:43.827033    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97421a3d_5cdd_4019_9fb5_d0d66106d2a2.slice/crio-21792ca3d09a3b3a525e3a32f71916de65d976918d99e2847242b72512e17b23 WatchSource:0}: Error finding container 21792ca3d09a3b3a525e3a32f71916de65d976918d99e2847242b72512e17b23: Status 404 returned error can't find the container with id 21792ca3d09a3b3a525e3a32f71916de65d976918d99e2847242b72512e17b23
Sep 11 17:54:44.201262 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:44.201178    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c899f7bf-j4ltc" event={"ID":"97421a3d-5cdd-4019-9fb5-d0d66106d2a2","Type":"ContainerStarted","Data":"21792ca3d09a3b3a525e3a32f71916de65d976918d99e2847242b72512e17b23"}
Sep 11 17:54:47.218526 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:47.218490    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c899f7bf-j4ltc" event={"ID":"97421a3d-5cdd-4019-9fb5-d0d66106d2a2","Type":"ContainerStarted","Data":"4b81247ff46ecb051f73e0fbc6b69946af27acf7db3bf54aac55d2d5a80c119c"}
Sep 11 17:54:47.218937 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:47.218561    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c899f7bf-j4ltc"
Sep 11 17:54:47.313400 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:47.313349    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c899f7bf-j4ltc" podStartSLOduration=1.579060914 podStartE2EDuration="4.313323357s" totalImagesPullingTime="2.734262443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:54:47.311799831 +0000 UTC m=+580.237751578" watchObservedRunningTime="2026-09-11 17:54:47.313323357 +0000 UTC m=+580.239275103"
Sep 11 17:54:58.226569 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:58.226538    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c899f7bf-j4ltc"
Sep 11 17:54:58.610972 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:58.610932    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c899f7bf-j4ltc"]
Sep 11 17:54:58.611156 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:58.611133    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-c899f7bf-j4ltc" podUID="97421a3d-5cdd-4019-9fb5-d0d66106d2a2" containerName="manager" containerID="cri-o://4b81247ff46ecb051f73e0fbc6b69946af27acf7db3bf54aac55d2d5a80c119c" gracePeriod=30
Sep 11 17:54:58.859027 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:58.859001    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c899f7bf-j4ltc"
Sep 11 17:54:58.919749 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:58.919678    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkwjf\" (UniqueName: \"kubernetes.io/projected/97421a3d-5cdd-4019-9fb5-d0d66106d2a2-kube-api-access-jkwjf\") pod \"97421a3d-5cdd-4019-9fb5-d0d66106d2a2\" (UID: \"97421a3d-5cdd-4019-9fb5-d0d66106d2a2\") "
Sep 11 17:54:58.919749 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:58.919716    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97421a3d-5cdd-4019-9fb5-d0d66106d2a2-metrics-certs\") pod \"97421a3d-5cdd-4019-9fb5-d0d66106d2a2\" (UID: \"97421a3d-5cdd-4019-9fb5-d0d66106d2a2\") "
Sep 11 17:54:58.919749 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:58.919732    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97421a3d-5cdd-4019-9fb5-d0d66106d2a2-webhook-cert\") pod \"97421a3d-5cdd-4019-9fb5-d0d66106d2a2\" (UID: \"97421a3d-5cdd-4019-9fb5-d0d66106d2a2\") "
Sep 11 17:54:58.921949 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:58.921913    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97421a3d-5cdd-4019-9fb5-d0d66106d2a2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "97421a3d-5cdd-4019-9fb5-d0d66106d2a2" (UID: "97421a3d-5cdd-4019-9fb5-d0d66106d2a2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:54:58.922062 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:58.921956    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97421a3d-5cdd-4019-9fb5-d0d66106d2a2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "97421a3d-5cdd-4019-9fb5-d0d66106d2a2" (UID: "97421a3d-5cdd-4019-9fb5-d0d66106d2a2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:54:58.922062 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:58.921962    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97421a3d-5cdd-4019-9fb5-d0d66106d2a2-kube-api-access-jkwjf" (OuterVolumeSpecName: "kube-api-access-jkwjf") pod "97421a3d-5cdd-4019-9fb5-d0d66106d2a2" (UID: "97421a3d-5cdd-4019-9fb5-d0d66106d2a2"). InnerVolumeSpecName "kube-api-access-jkwjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:54:59.021164 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:59.021123    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkwjf\" (UniqueName: \"kubernetes.io/projected/97421a3d-5cdd-4019-9fb5-d0d66106d2a2-kube-api-access-jkwjf\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:54:59.021164 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:59.021161    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97421a3d-5cdd-4019-9fb5-d0d66106d2a2-metrics-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:54:59.021164 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:59.021173    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97421a3d-5cdd-4019-9fb5-d0d66106d2a2-webhook-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:54:59.276821 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:59.276785    2579 generic.go:356] "Generic (PLEG): container finished" podID="97421a3d-5cdd-4019-9fb5-d0d66106d2a2" containerID="4b81247ff46ecb051f73e0fbc6b69946af27acf7db3bf54aac55d2d5a80c119c" exitCode=0
Sep 11 17:54:59.276821 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:59.276824    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c899f7bf-j4ltc"
Sep 11 17:54:59.277298 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:59.276864    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c899f7bf-j4ltc" event={"ID":"97421a3d-5cdd-4019-9fb5-d0d66106d2a2","Type":"ContainerDied","Data":"4b81247ff46ecb051f73e0fbc6b69946af27acf7db3bf54aac55d2d5a80c119c"}
Sep 11 17:54:59.277298 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:59.276942    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c899f7bf-j4ltc" event={"ID":"97421a3d-5cdd-4019-9fb5-d0d66106d2a2","Type":"ContainerDied","Data":"21792ca3d09a3b3a525e3a32f71916de65d976918d99e2847242b72512e17b23"}
Sep 11 17:54:59.277298 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:59.276968    2579 scope.go:117] "RemoveContainer" containerID="4b81247ff46ecb051f73e0fbc6b69946af27acf7db3bf54aac55d2d5a80c119c"
Sep 11 17:54:59.285940 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:59.285921    2579 scope.go:117] "RemoveContainer" containerID="4b81247ff46ecb051f73e0fbc6b69946af27acf7db3bf54aac55d2d5a80c119c"
Sep 11 17:54:59.286192 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:54:59.286172    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b81247ff46ecb051f73e0fbc6b69946af27acf7db3bf54aac55d2d5a80c119c\": container with ID starting with 4b81247ff46ecb051f73e0fbc6b69946af27acf7db3bf54aac55d2d5a80c119c not found: ID does not exist" containerID="4b81247ff46ecb051f73e0fbc6b69946af27acf7db3bf54aac55d2d5a80c119c"
Sep 11 17:54:59.286274 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:59.286201    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b81247ff46ecb051f73e0fbc6b69946af27acf7db3bf54aac55d2d5a80c119c"} err="failed to get container status \"4b81247ff46ecb051f73e0fbc6b69946af27acf7db3bf54aac55d2d5a80c119c\": rpc error: code = NotFound desc = could not find container \"4b81247ff46ecb051f73e0fbc6b69946af27acf7db3bf54aac55d2d5a80c119c\": container with ID starting with 4b81247ff46ecb051f73e0fbc6b69946af27acf7db3bf54aac55d2d5a80c119c not found: ID does not exist"
Sep 11 17:54:59.308348 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:59.308320    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c899f7bf-j4ltc"]
Sep 11 17:54:59.312552 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:59.312527    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c899f7bf-j4ltc"]
Sep 11 17:54:59.534238 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:54:59.534158    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97421a3d-5cdd-4019-9fb5-d0d66106d2a2" path="/var/lib/kubelet/pods/97421a3d-5cdd-4019-9fb5-d0d66106d2a2/volumes"
Sep 11 17:55:07.468917 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:07.468885    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-bbhjk_46c0eccf-9fc2-4fbf-ae39-3b1cf093b352/console-operator/1.log"
Sep 11 17:55:07.469479 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:07.469459    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-bbhjk_46c0eccf-9fc2-4fbf-ae39-3b1cf093b352/console-operator/1.log"
Sep 11 17:55:07.472795 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:07.472753    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zx6_cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd/ovn-acl-logging/0.log"
Sep 11 17:55:07.473279 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:07.473265    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zx6_cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd/ovn-acl-logging/0.log"
Sep 11 17:55:21.775696 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:21.775656    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-f858k"]
Sep 11 17:55:21.776181 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:21.776077    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97421a3d-5cdd-4019-9fb5-d0d66106d2a2" containerName="manager"
Sep 11 17:55:21.776181 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:21.776090    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="97421a3d-5cdd-4019-9fb5-d0d66106d2a2" containerName="manager"
Sep 11 17:55:21.776181 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:21.776162    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="97421a3d-5cdd-4019-9fb5-d0d66106d2a2" containerName="manager"
Sep 11 17:55:21.781305 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:21.781287    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f858k"
Sep 11 17:55:21.786123 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:21.786104    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 11 17:55:21.786224 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:21.786190    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-g9665\""
Sep 11 17:55:21.802187 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:21.802161    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-f858k"]
Sep 11 17:55:21.930283 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:21.930248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d16f34f1-6634-4930-bc4e-f78a3a0d05c7-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-f858k\" (UID: \"d16f34f1-6634-4930-bc4e-f78a3a0d05c7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f858k"
Sep 11 17:55:21.930447 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:21.930326    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwwxw\" (UniqueName: \"kubernetes.io/projected/d16f34f1-6634-4930-bc4e-f78a3a0d05c7-kube-api-access-jwwxw\") pod \"payload-pre-processing-59fbc47bf8-f858k\" (UID: \"d16f34f1-6634-4930-bc4e-f78a3a0d05c7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f858k"
Sep 11 17:55:22.031360 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:22.031264    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d16f34f1-6634-4930-bc4e-f78a3a0d05c7-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-f858k\" (UID: \"d16f34f1-6634-4930-bc4e-f78a3a0d05c7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f858k"
Sep 11 17:55:22.031360 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:22.031355    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwwxw\" (UniqueName: \"kubernetes.io/projected/d16f34f1-6634-4930-bc4e-f78a3a0d05c7-kube-api-access-jwwxw\") pod \"payload-pre-processing-59fbc47bf8-f858k\" (UID: \"d16f34f1-6634-4930-bc4e-f78a3a0d05c7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f858k"
Sep 11 17:55:22.032070 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:22.032048    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d16f34f1-6634-4930-bc4e-f78a3a0d05c7-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-f858k\" (UID: \"d16f34f1-6634-4930-bc4e-f78a3a0d05c7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f858k"
Sep 11 17:55:22.041905 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:22.041881    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwwxw\" (UniqueName: \"kubernetes.io/projected/d16f34f1-6634-4930-bc4e-f78a3a0d05c7-kube-api-access-jwwxw\") pod \"payload-pre-processing-59fbc47bf8-f858k\" (UID: \"d16f34f1-6634-4930-bc4e-f78a3a0d05c7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f858k"
Sep 11 17:55:22.091782 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:22.091725    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f858k"
Sep 11 17:55:22.368086 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:22.368054    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-f858k"]
Sep 11 17:55:22.415024 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:22.414985    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f858k" event={"ID":"d16f34f1-6634-4930-bc4e-f78a3a0d05c7","Type":"ContainerStarted","Data":"0d0a190f02ba42a4d9d46ee5ea57c5d2bbd111f971872752891149fa9de5178a"}
Sep 11 17:55:25.434496 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:25.434461    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f858k" event={"ID":"d16f34f1-6634-4930-bc4e-f78a3a0d05c7","Type":"ContainerStarted","Data":"564a45601c05bb3fb34f6511209fc459b2b6d4dcc87d23be2f09e21c5a62f5f5"}
Sep 11 17:55:25.434906 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:25.434594    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f858k"
Sep 11 17:55:25.455075 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:25.455030    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f858k" podStartSLOduration=2.490299081 podStartE2EDuration="4.455014193s" totalImagesPullingTime="1.964715112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:55:25.454141509 +0000 UTC m=+618.380093257" watchObservedRunningTime="2026-09-11 17:55:25.455014193 +0000 UTC m=+618.380965942"
Sep 11 17:55:30.983043 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:30.982956    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-9z8xb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 11 17:55:30.983433 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:30.983043    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb" podUID="15a0c1fc-f412-439b-993d-b4d4008122a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 11 17:55:31.467386 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:31.467354    2579 generic.go:356] "Generic (PLEG): container finished" podID="15a0c1fc-f412-439b-993d-b4d4008122a2" containerID="2ad8907beecb7cca6636630332e18d210d054b96375b6c4d9b7be7b2858c33b8" exitCode=0
Sep 11 17:55:31.467548 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:31.467409    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb" event={"ID":"15a0c1fc-f412-439b-993d-b4d4008122a2","Type":"ContainerDied","Data":"2ad8907beecb7cca6636630332e18d210d054b96375b6c4d9b7be7b2858c33b8"}
Sep 11 17:55:31.467770 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:31.467748    2579 scope.go:117] "RemoveContainer" containerID="2ad8907beecb7cca6636630332e18d210d054b96375b6c4d9b7be7b2858c33b8"
Sep 11 17:55:31.468756 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:31.468728    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:55:31.468831 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:31.468811    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:55:31.468876 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:31.468863    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:55:32.474251 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:32.474217    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb" event={"ID":"15a0c1fc-f412-439b-993d-b4d4008122a2","Type":"ContainerStarted","Data":"622524b837b4f618384dba526ca63532ca31d90c27d7b7209ddb68acce3c950d"}
Sep 11 17:55:32.591057 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:32.591017    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:55:32.591262 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:32.591070    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-9z8xb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 11 17:55:32.591262 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:32.591134    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb" podUID="15a0c1fc-f412-439b-993d-b4d4008122a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 11 17:55:33.590541 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:33.590495    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-9z8xb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 11 17:55:33.591052 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:33.590597    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb" podUID="15a0c1fc-f412-439b-993d-b4d4008122a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 11 17:55:34.590680 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:34.590633    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-9z8xb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 11 17:55:34.591185 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:34.590746    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb" podUID="15a0c1fc-f412-439b-993d-b4d4008122a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 11 17:55:35.591108 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:35.591062    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-9z8xb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 11 17:55:35.591572 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:35.591131    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb" podUID="15a0c1fc-f412-439b-993d-b4d4008122a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 11 17:55:36.441322 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:36.441291    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f858k"
Sep 11 17:55:36.593791 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:36.592154    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-9z8xb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 11 17:55:36.593791 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:36.592227    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb" podUID="15a0c1fc-f412-439b-993d-b4d4008122a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 11 17:55:37.594614 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:37.594582    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:55:37.595010 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:37.594984    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:55:37.595614 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:37.595596    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb"
Sep 11 17:55:42.215724 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.215688    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"]
Sep 11 17:55:42.224342 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.224309    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:42.236928 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.236905    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 17:55:42.236928 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.236925    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jwbsk\""
Sep 11 17:55:42.237112 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.236972    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 11 17:55:42.237112 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.236983    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 17:55:42.258152 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.258126    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"]
Sep 11 17:55:42.314072 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.314026    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64fabc45-3b2f-491d-894b-275d0202b64e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx\" (UID: \"64fabc45-3b2f-491d-894b-275d0202b64e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:42.314072 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.314079    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64fabc45-3b2f-491d-894b-275d0202b64e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx\" (UID: \"64fabc45-3b2f-491d-894b-275d0202b64e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:42.314326 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.314155    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64fabc45-3b2f-491d-894b-275d0202b64e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx\" (UID: \"64fabc45-3b2f-491d-894b-275d0202b64e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:42.314326 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.314233    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j28wv\" (UniqueName: \"kubernetes.io/projected/64fabc45-3b2f-491d-894b-275d0202b64e-kube-api-access-j28wv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx\" (UID: \"64fabc45-3b2f-491d-894b-275d0202b64e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:42.314438 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.314347    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64fabc45-3b2f-491d-894b-275d0202b64e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx\" (UID: \"64fabc45-3b2f-491d-894b-275d0202b64e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:42.314438 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.314375    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64fabc45-3b2f-491d-894b-275d0202b64e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx\" (UID: \"64fabc45-3b2f-491d-894b-275d0202b64e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:42.415380 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.415341    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j28wv\" (UniqueName: \"kubernetes.io/projected/64fabc45-3b2f-491d-894b-275d0202b64e-kube-api-access-j28wv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx\" (UID: \"64fabc45-3b2f-491d-894b-275d0202b64e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:42.415571 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.415425    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64fabc45-3b2f-491d-894b-275d0202b64e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx\" (UID: \"64fabc45-3b2f-491d-894b-275d0202b64e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:42.415571 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.415448    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64fabc45-3b2f-491d-894b-275d0202b64e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx\" (UID: \"64fabc45-3b2f-491d-894b-275d0202b64e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:42.415571 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.415467    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64fabc45-3b2f-491d-894b-275d0202b64e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx\" (UID: \"64fabc45-3b2f-491d-894b-275d0202b64e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:42.415571 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.415491    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64fabc45-3b2f-491d-894b-275d0202b64e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx\" (UID: \"64fabc45-3b2f-491d-894b-275d0202b64e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:42.415571 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.415519    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64fabc45-3b2f-491d-894b-275d0202b64e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx\" (UID: \"64fabc45-3b2f-491d-894b-275d0202b64e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:42.415951 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.415926    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64fabc45-3b2f-491d-894b-275d0202b64e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx\" (UID: \"64fabc45-3b2f-491d-894b-275d0202b64e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:42.415990 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.415939    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64fabc45-3b2f-491d-894b-275d0202b64e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx\" (UID: \"64fabc45-3b2f-491d-894b-275d0202b64e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:42.416026 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.415988    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64fabc45-3b2f-491d-894b-275d0202b64e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx\" (UID: \"64fabc45-3b2f-491d-894b-275d0202b64e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:42.417806 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.417788    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64fabc45-3b2f-491d-894b-275d0202b64e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx\" (UID: \"64fabc45-3b2f-491d-894b-275d0202b64e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:42.418222 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.418201    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64fabc45-3b2f-491d-894b-275d0202b64e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx\" (UID: \"64fabc45-3b2f-491d-894b-275d0202b64e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:42.428254 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.428229    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j28wv\" (UniqueName: \"kubernetes.io/projected/64fabc45-3b2f-491d-894b-275d0202b64e-kube-api-access-j28wv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx\" (UID: \"64fabc45-3b2f-491d-894b-275d0202b64e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:42.535293 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.535256    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:42.816285 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:42.816189    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"]
Sep 11 17:55:42.819089 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:55:42.819064    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64fabc45_3b2f_491d_894b_275d0202b64e.slice/crio-6ac608c393b32352ce0de0a042d1f94a180c664920612fcd1a67ccca5cb771fb WatchSource:0}: Error finding container 6ac608c393b32352ce0de0a042d1f94a180c664920612fcd1a67ccca5cb771fb: Status 404 returned error can't find the container with id 6ac608c393b32352ce0de0a042d1f94a180c664920612fcd1a67ccca5cb771fb
Sep 11 17:55:43.537333 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:43.537299    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx" event={"ID":"64fabc45-3b2f-491d-894b-275d0202b64e","Type":"ContainerStarted","Data":"6ac608c393b32352ce0de0a042d1f94a180c664920612fcd1a67ccca5cb771fb"}
Sep 11 17:55:44.543200 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:44.543162    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx" event={"ID":"64fabc45-3b2f-491d-894b-275d0202b64e","Type":"ContainerStarted","Data":"5cd81e7ebced28c0b63bd275fc1ef472587b221db9cd6603858214dc1377fb75"}
Sep 11 17:55:44.587787 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:44.587721    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx" podStartSLOduration=1.464289319 podStartE2EDuration="2.587704158s" totalImagesPullingTime="1.123414839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:55:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:55:44.58598692 +0000 UTC m=+637.511938700" watchObservedRunningTime="2026-09-11 17:55:44.587704158 +0000 UTC m=+637.513655904"
Sep 11 17:55:51.964009 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:51.963968    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"]
Sep 11 17:55:51.967718 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:51.967696    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:55:51.971395 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:51.971369    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 11 17:55:51.994613 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:51.994586    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"]
Sep 11 17:55:51.997612 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:51.997588    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/711e47e0-66fd-4575-b6fe-c2a67f0c39a1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4shm\" (UID: \"711e47e0-66fd-4575-b6fe-c2a67f0c39a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:55:51.997721 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:51.997625    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2j7t\" (UniqueName: \"kubernetes.io/projected/711e47e0-66fd-4575-b6fe-c2a67f0c39a1-kube-api-access-m2j7t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4shm\" (UID: \"711e47e0-66fd-4575-b6fe-c2a67f0c39a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:55:51.997721 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:51.997654    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/711e47e0-66fd-4575-b6fe-c2a67f0c39a1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4shm\" (UID: \"711e47e0-66fd-4575-b6fe-c2a67f0c39a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:55:51.997840 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:51.997789    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/711e47e0-66fd-4575-b6fe-c2a67f0c39a1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4shm\" (UID: \"711e47e0-66fd-4575-b6fe-c2a67f0c39a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:55:51.997840 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:51.997828    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/711e47e0-66fd-4575-b6fe-c2a67f0c39a1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4shm\" (UID: \"711e47e0-66fd-4575-b6fe-c2a67f0c39a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:55:51.997937 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:51.997847    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/711e47e0-66fd-4575-b6fe-c2a67f0c39a1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4shm\" (UID: \"711e47e0-66fd-4575-b6fe-c2a67f0c39a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:55:52.099103 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:52.099075    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/711e47e0-66fd-4575-b6fe-c2a67f0c39a1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4shm\" (UID: \"711e47e0-66fd-4575-b6fe-c2a67f0c39a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:55:52.099290 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:52.099116    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/711e47e0-66fd-4575-b6fe-c2a67f0c39a1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4shm\" (UID: \"711e47e0-66fd-4575-b6fe-c2a67f0c39a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:55:52.099290 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:52.099134    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/711e47e0-66fd-4575-b6fe-c2a67f0c39a1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4shm\" (UID: \"711e47e0-66fd-4575-b6fe-c2a67f0c39a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:55:52.099290 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:52.099192    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/711e47e0-66fd-4575-b6fe-c2a67f0c39a1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4shm\" (UID: \"711e47e0-66fd-4575-b6fe-c2a67f0c39a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:55:52.099290 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:52.099211    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2j7t\" (UniqueName: \"kubernetes.io/projected/711e47e0-66fd-4575-b6fe-c2a67f0c39a1-kube-api-access-m2j7t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4shm\" (UID: \"711e47e0-66fd-4575-b6fe-c2a67f0c39a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:55:52.099290 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:52.099232    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/711e47e0-66fd-4575-b6fe-c2a67f0c39a1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4shm\" (UID: \"711e47e0-66fd-4575-b6fe-c2a67f0c39a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:55:52.099612 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:52.099589    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/711e47e0-66fd-4575-b6fe-c2a67f0c39a1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4shm\" (UID: \"711e47e0-66fd-4575-b6fe-c2a67f0c39a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:55:52.099675 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:52.099623    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/711e47e0-66fd-4575-b6fe-c2a67f0c39a1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4shm\" (UID: \"711e47e0-66fd-4575-b6fe-c2a67f0c39a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:55:52.099675 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:52.099647    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/711e47e0-66fd-4575-b6fe-c2a67f0c39a1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4shm\" (UID: \"711e47e0-66fd-4575-b6fe-c2a67f0c39a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:55:52.101305 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:52.101285    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/711e47e0-66fd-4575-b6fe-c2a67f0c39a1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4shm\" (UID: \"711e47e0-66fd-4575-b6fe-c2a67f0c39a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:55:52.101581 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:52.101562    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/711e47e0-66fd-4575-b6fe-c2a67f0c39a1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4shm\" (UID: \"711e47e0-66fd-4575-b6fe-c2a67f0c39a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:55:52.111324 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:52.111240    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2j7t\" (UniqueName: \"kubernetes.io/projected/711e47e0-66fd-4575-b6fe-c2a67f0c39a1-kube-api-access-m2j7t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4shm\" (UID: \"711e47e0-66fd-4575-b6fe-c2a67f0c39a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:55:52.278388 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:52.278345    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:55:52.535838 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:52.535753    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:52.535838 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:52.535820    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:52.548367 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:52.548341    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:52.569886 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:52.569773    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"]
Sep 11 17:55:52.572331 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:55:52.572306    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod711e47e0_66fd_4575_b6fe_c2a67f0c39a1.slice/crio-9d82466d309d302e341055e96da41b3365980f22d12d7efcfd4ff689e57000cf WatchSource:0}: Error finding container 9d82466d309d302e341055e96da41b3365980f22d12d7efcfd4ff689e57000cf: Status 404 returned error can't find the container with id 9d82466d309d302e341055e96da41b3365980f22d12d7efcfd4ff689e57000cf
Sep 11 17:55:52.573860 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:52.573842    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 17:55:52.584544 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:52.584520    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm" event={"ID":"711e47e0-66fd-4575-b6fe-c2a67f0c39a1","Type":"ContainerStarted","Data":"9d82466d309d302e341055e96da41b3365980f22d12d7efcfd4ff689e57000cf"}
Sep 11 17:55:52.596022 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:52.595996    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx"
Sep 11 17:55:53.594672 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:55:53.594631    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm" event={"ID":"711e47e0-66fd-4575-b6fe-c2a67f0c39a1","Type":"ContainerStarted","Data":"c8f427862628d9ae0d9c9b9cbe52eba20f09e80a4bdd8820ea7804dd1b15f08a"}
Sep 11 17:56:02.278698 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:02.278660    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:56:02.279133 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:02.278720    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:56:02.291083 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:02.291045    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:56:02.312803 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:02.312739    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm" podStartSLOduration=11.138750895 podStartE2EDuration="11.312722371s" totalImagesPullingTime="173.971476ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:55:53.62296166 +0000 UTC m=+646.548913406" watchObservedRunningTime="2026-09-11 17:56:02.312722371 +0000 UTC m=+655.238674117"
Sep 11 17:56:02.651858 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:02.651772    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4shm"
Sep 11 17:56:07.251856 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.251822    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"]
Sep 11 17:56:07.256667 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.256643    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:07.258831 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.258799    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 11 17:56:07.266440 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.266411    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"]
Sep 11 17:56:07.348075 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.348040    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc55f671-4269-415d-a71d-618264b8a0de-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8g7p8\" (UID: \"bc55f671-4269-415d-a71d-618264b8a0de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:07.348281 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.348106    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbhws\" (UniqueName: \"kubernetes.io/projected/bc55f671-4269-415d-a71d-618264b8a0de-kube-api-access-kbhws\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8g7p8\" (UID: \"bc55f671-4269-415d-a71d-618264b8a0de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:07.348281 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.348167    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc55f671-4269-415d-a71d-618264b8a0de-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8g7p8\" (UID: \"bc55f671-4269-415d-a71d-618264b8a0de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:07.348281 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.348231    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc55f671-4269-415d-a71d-618264b8a0de-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8g7p8\" (UID: \"bc55f671-4269-415d-a71d-618264b8a0de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:07.348281 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.348282    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc55f671-4269-415d-a71d-618264b8a0de-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8g7p8\" (UID: \"bc55f671-4269-415d-a71d-618264b8a0de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:07.348512 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.348314    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc55f671-4269-415d-a71d-618264b8a0de-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8g7p8\" (UID: \"bc55f671-4269-415d-a71d-618264b8a0de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:07.449043 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.449005    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc55f671-4269-415d-a71d-618264b8a0de-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8g7p8\" (UID: \"bc55f671-4269-415d-a71d-618264b8a0de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:07.449196 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.449081    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc55f671-4269-415d-a71d-618264b8a0de-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8g7p8\" (UID: \"bc55f671-4269-415d-a71d-618264b8a0de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:07.449196 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.449114    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc55f671-4269-415d-a71d-618264b8a0de-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8g7p8\" (UID: \"bc55f671-4269-415d-a71d-618264b8a0de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:07.449196 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.449155    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc55f671-4269-415d-a71d-618264b8a0de-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8g7p8\" (UID: \"bc55f671-4269-415d-a71d-618264b8a0de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:07.449438 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.449194    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbhws\" (UniqueName: \"kubernetes.io/projected/bc55f671-4269-415d-a71d-618264b8a0de-kube-api-access-kbhws\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8g7p8\" (UID: \"bc55f671-4269-415d-a71d-618264b8a0de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:07.449438 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.449253    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc55f671-4269-415d-a71d-618264b8a0de-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8g7p8\" (UID: \"bc55f671-4269-415d-a71d-618264b8a0de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:07.449552 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.449529    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc55f671-4269-415d-a71d-618264b8a0de-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8g7p8\" (UID: \"bc55f671-4269-415d-a71d-618264b8a0de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:07.449609 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.449576    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc55f671-4269-415d-a71d-618264b8a0de-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8g7p8\" (UID: \"bc55f671-4269-415d-a71d-618264b8a0de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:07.449652 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.449602    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc55f671-4269-415d-a71d-618264b8a0de-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8g7p8\" (UID: \"bc55f671-4269-415d-a71d-618264b8a0de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:07.451497 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.451471    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc55f671-4269-415d-a71d-618264b8a0de-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8g7p8\" (UID: \"bc55f671-4269-415d-a71d-618264b8a0de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:07.451877 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.451859    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 11 17:56:07.462009 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.461984    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc55f671-4269-415d-a71d-618264b8a0de-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8g7p8\" (UID: \"bc55f671-4269-415d-a71d-618264b8a0de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:07.462202 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.462178    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbhws\" (UniqueName: \"kubernetes.io/projected/bc55f671-4269-415d-a71d-618264b8a0de-kube-api-access-kbhws\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8g7p8\" (UID: \"bc55f671-4269-415d-a71d-618264b8a0de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:07.568850 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.568744    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:07.851031 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:07.851002    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"]
Sep 11 17:56:07.852577 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:56:07.852548    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc55f671_4269_415d_a71d_618264b8a0de.slice/crio-f6e25c5971562be37b66cb9d911b5b3fe1fa2e50a1bf8f339ce23af659d2c08e WatchSource:0}: Error finding container f6e25c5971562be37b66cb9d911b5b3fe1fa2e50a1bf8f339ce23af659d2c08e: Status 404 returned error can't find the container with id f6e25c5971562be37b66cb9d911b5b3fe1fa2e50a1bf8f339ce23af659d2c08e
Sep 11 17:56:08.669253 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:08.669218    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8" event={"ID":"bc55f671-4269-415d-a71d-618264b8a0de","Type":"ContainerStarted","Data":"745a5a7cd7d8cbf1ed4d996d54317e78c97a55314ae39331503f28eecd6cc71e"}
Sep 11 17:56:08.669673 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:08.669269    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8" event={"ID":"bc55f671-4269-415d-a71d-618264b8a0de","Type":"ContainerStarted","Data":"f6e25c5971562be37b66cb9d911b5b3fe1fa2e50a1bf8f339ce23af659d2c08e"}
Sep 11 17:56:08.705796 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:08.705729    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8" podStartSLOduration=1.51506098 podStartE2EDuration="1.705707547s" totalImagesPullingTime="190.646567ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:56:08.703901843 +0000 UTC m=+661.629853600" watchObservedRunningTime="2026-09-11 17:56:08.705707547 +0000 UTC m=+661.631659294"
Sep 11 17:56:17.569247 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:17.569213    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:17.569632 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:17.569280    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:17.582302 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:17.582271    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:56:17.725879 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:56:17.725845    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8g7p8"
Sep 11 17:57:59.572416 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.572379    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"]
Sep 11 17:57:59.574892 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.574870    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.578719 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.578696    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-67477b-openshift-default-dockercfg-wv8x4\""
Sep 11 17:57:59.595948 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.595911    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-workload-certs\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.596132 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.595971    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-envoy\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.596132 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.596036    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-podinfo\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.596132 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.596059    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-credential-socket\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.596309 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.596148    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istiod-ca-cert\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.596309 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.596193    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-workload-socket\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.596309 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.596218    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-token\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.596309 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.596249    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtmrc\" (UniqueName: \"kubernetes.io/projected/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-kube-api-access-gtmrc\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.596440 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.596322    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-data\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.610793 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.610730    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"]
Sep 11 17:57:59.697737 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.697695    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-data\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.697737 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.697745    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-workload-certs\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.698005 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.697895    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-envoy\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.698005 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.697943    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-podinfo\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.698106 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.698076    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-credential-socket\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.698165 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.698145    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-data\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.698224 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.698162    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istiod-ca-cert\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.698224 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.698199    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-workload-certs\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.698328 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.698206    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-workload-socket\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.698328 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.698255    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-token\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.698328 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.698289    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtmrc\" (UniqueName: \"kubernetes.io/projected/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-kube-api-access-gtmrc\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.698490 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.698415    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-credential-socket\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.698548 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.698487    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-workload-socket\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.698997 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.698975    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istiod-ca-cert\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.700266 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.700236    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-envoy\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.700431 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.700412    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-podinfo\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.714739 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.714706    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtmrc\" (UniqueName: \"kubernetes.io/projected/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-kube-api-access-gtmrc\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.714909 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.714886    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-token\") pod \"e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") " pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:57:59.884872 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:57:59.884755    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:58:00.165178 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:00.165093    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"]
Sep 11 17:58:00.168171 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:58:00.168145    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fdaf95b_34ff_4f64_a5c9_fc7e9083d372.slice/crio-c42d93926124488ba89c8c1e3170faa050471b32af6e3b7d259d2fec88a71366 WatchSource:0}: Error finding container c42d93926124488ba89c8c1e3170faa050471b32af6e3b7d259d2fec88a71366: Status 404 returned error can't find the container with id c42d93926124488ba89c8c1e3170faa050471b32af6e3b7d259d2fec88a71366
Sep 11 17:58:00.170402 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:00.170373    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:00.170468 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:00.170436    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:00.170468 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:00.170461    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:00.233518 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:00.233487    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw" event={"ID":"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372","Type":"ContainerStarted","Data":"5459b8b59c5672cfcdc3fa6dfda11f812ce58423cec1f4e67d776019d4250858"}
Sep 11 17:58:00.233664 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:00.233548    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw" event={"ID":"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372","Type":"ContainerStarted","Data":"c42d93926124488ba89c8c1e3170faa050471b32af6e3b7d259d2fec88a71366"}
Sep 11 17:58:00.262073 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:00.262002    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw" podStartSLOduration=1.261979738 podStartE2EDuration="1.261979738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:57:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:58:00.259545138 +0000 UTC m=+773.185496877" watchObservedRunningTime="2026-09-11 17:58:00.261979738 +0000 UTC m=+773.187931513"
Sep 11 17:58:00.885042 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:00.885003    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:58:01.891312 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:01.891281    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:58:02.246728 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:02.246695    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:58:02.247720 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:02.247701    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:58:08.027867 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.027835    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"]
Sep 11 17:58:08.031493 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.031470    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.036102 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.036083    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f412cf1d-openshift-default-dockercfg-7vrkt\""
Sep 11 17:58:08.049227 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.049205    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"]
Sep 11 17:58:08.079927 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.079896    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-credential-socket\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.080096 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.079960    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-workload-socket\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.080096 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.080030    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-envoy\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.080096 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.080085    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-workload-certs\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.080273 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.080161    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-podinfo\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.080273 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.080197    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istiod-ca-cert\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.080273 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.080223    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-token\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.080386 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.080284    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g42t2\" (UniqueName: \"kubernetes.io/projected/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-kube-api-access-g42t2\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.080386 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.080328    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-data\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.181423 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.181389    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-workload-certs\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.181581 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.181450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-podinfo\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.181581 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.181484    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istiod-ca-cert\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.181581 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.181509    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-token\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.181581 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.181555    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g42t2\" (UniqueName: \"kubernetes.io/projected/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-kube-api-access-g42t2\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.181792 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.181613    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-data\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.181792 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.181642    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-credential-socket\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.181792 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.181711    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-workload-socket\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.181958 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.181842    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-envoy\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.182013 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.181950    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-workload-certs\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.182095 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.182075    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-data\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.182143 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.182112    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-credential-socket\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.182181 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.182166    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-workload-socket\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.182379 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.182354    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istiod-ca-cert\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.184115 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.184082    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-envoy\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.184216 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.184165    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-podinfo\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.190586 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.190560    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g42t2\" (UniqueName: \"kubernetes.io/projected/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-kube-api-access-g42t2\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.191612 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.191591    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-token\") pod \"e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") " pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.343522 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.343428    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:08.482771 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.482706    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"]
Sep 11 17:58:08.486540 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.486520    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.489118 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.489099    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-5883b7-openshift-default-dockercfg-ng6ck\""
Sep 11 17:58:08.550181 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.550148    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"]
Sep 11 17:58:08.586632 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.586601    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-workload-certs\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.586632 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.586643    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-istio-data\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.586896 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.586675    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a89401a-cd21-48ae-af46-15729267940f-istio-token\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.586896 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.586703    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-workload-socket\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.586896 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.586794    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-credential-socket\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.586896 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.586860    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a89401a-cd21-48ae-af46-15729267940f-istiod-ca-cert\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.587104 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.586900    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-istio-envoy\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.587104 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.586948    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a89401a-cd21-48ae-af46-15729267940f-istio-podinfo\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.587104 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.587009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66qkp\" (UniqueName: \"kubernetes.io/projected/6a89401a-cd21-48ae-af46-15729267940f-kube-api-access-66qkp\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.639348 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.639270    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"]
Sep 11 17:58:08.642512 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:58:08.642480    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd0fcc4a_19cc_46d4_8b2c_6e7f8673c207.slice/crio-7dd380daee726d04dded324c405c60bf36ff62d69682881cfd47dfb27dbe466c WatchSource:0}: Error finding container 7dd380daee726d04dded324c405c60bf36ff62d69682881cfd47dfb27dbe466c: Status 404 returned error can't find the container with id 7dd380daee726d04dded324c405c60bf36ff62d69682881cfd47dfb27dbe466c
Sep 11 17:58:08.645034 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.645000    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:08.645130 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.645081    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:08.645198 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.645126    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:08.688544 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.688513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a89401a-cd21-48ae-af46-15729267940f-istio-podinfo\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.688663 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.688574    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66qkp\" (UniqueName: \"kubernetes.io/projected/6a89401a-cd21-48ae-af46-15729267940f-kube-api-access-66qkp\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.688752 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.688733    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-workload-certs\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.688829 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.688806    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-istio-data\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.688883 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.688840    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a89401a-cd21-48ae-af46-15729267940f-istio-token\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.688883 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.688868    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-workload-socket\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.688999 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.688908    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-credential-socket\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.688999 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.688969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a89401a-cd21-48ae-af46-15729267940f-istiod-ca-cert\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.689112 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.689005    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-istio-envoy\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.689292 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.689218    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-workload-certs\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.689292 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.689244    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-workload-socket\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.689510 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.689489    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-istio-data\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.689732 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.689709    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-credential-socket\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.690174 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.690151    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a89401a-cd21-48ae-af46-15729267940f-istiod-ca-cert\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.691238 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.691211    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a89401a-cd21-48ae-af46-15729267940f-istio-podinfo\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.692021 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.692001    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-istio-envoy\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.703081 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.703059    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a89401a-cd21-48ae-af46-15729267940f-istio-token\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.704909 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.704887    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66qkp\" (UniqueName: \"kubernetes.io/projected/6a89401a-cd21-48ae-af46-15729267940f-kube-api-access-66qkp\") pod \"e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") " pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:08.797210 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:08.797173    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:09.089903 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:09.089873    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"]
Sep 11 17:58:09.090620 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:58:09.090594    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a89401a_cd21_48ae_af46_15729267940f.slice/crio-b881fdafc578d8a52ea36a05942ed5c9aea87b6218f5441cb53b3738f5882895 WatchSource:0}: Error finding container b881fdafc578d8a52ea36a05942ed5c9aea87b6218f5441cb53b3738f5882895: Status 404 returned error can't find the container with id b881fdafc578d8a52ea36a05942ed5c9aea87b6218f5441cb53b3738f5882895
Sep 11 17:58:09.093044 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:09.093010    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:09.093140 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:09.093089    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:09.093140 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:09.093128    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:09.285684 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:09.285647    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz" event={"ID":"6a89401a-cd21-48ae-af46-15729267940f","Type":"ContainerStarted","Data":"18c175b9c698d5335eeacc4d3be12f2401883db5e0aa2f7ab3bf4d372630c360"}
Sep 11 17:58:09.285891 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:09.285711    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz" event={"ID":"6a89401a-cd21-48ae-af46-15729267940f","Type":"ContainerStarted","Data":"b881fdafc578d8a52ea36a05942ed5c9aea87b6218f5441cb53b3738f5882895"}
Sep 11 17:58:09.287660 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:09.287625    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5" event={"ID":"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207","Type":"ContainerStarted","Data":"aa865fc0fbcb306605ca02a97bd50f2e7fa70266c07c39ec29e13e0eca2661a2"}
Sep 11 17:58:09.287826 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:09.287680    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5" event={"ID":"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207","Type":"ContainerStarted","Data":"7dd380daee726d04dded324c405c60bf36ff62d69682881cfd47dfb27dbe466c"}
Sep 11 17:58:09.314097 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:09.314034    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz" podStartSLOduration=1.314014916 podStartE2EDuration="1.314014916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:58:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:58:09.3103599 +0000 UTC m=+782.236311648" watchObservedRunningTime="2026-09-11 17:58:09.314014916 +0000 UTC m=+782.239966686"
Sep 11 17:58:09.344003 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:09.343888    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5" podStartSLOduration=1.343866739 podStartE2EDuration="1.343866739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:58:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:58:09.342477724 +0000 UTC m=+782.268429470" watchObservedRunningTime="2026-09-11 17:58:09.343866739 +0000 UTC m=+782.269818500"
Sep 11 17:58:09.344575 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:09.344544    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:09.349409 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:09.349386    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:09.797454 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:09.797422    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:10.295217 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:10.295180    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:10.296610 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:10.296585    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:10.814364 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:10.814320    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:11.304988 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:11.304955    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:11.306825 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:11.306801    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:17.837930 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:17.837893    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"]
Sep 11 17:58:17.841924 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:17.841904    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:17.844670 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:17.844638    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-fb8c5d-openshift-default-dockercfg-4g5pm\""
Sep 11 17:58:17.875314 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:17.875283    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"]
Sep 11 17:58:17.987162 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:17.987111    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-credential-socket\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:17.987359 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:17.987184    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istiod-ca-cert\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:17.987359 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:17.987241    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-envoy\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:17.987494 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:17.987372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-workload-socket\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:17.987494 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:17.987433    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-podinfo\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:17.987494 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:17.987468    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-token\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:17.987639 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:17.987518    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c76gg\" (UniqueName: \"kubernetes.io/projected/7bc96fce-f061-41fc-9631-5bc5dc8ec029-kube-api-access-c76gg\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:17.987639 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:17.987562    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-data\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:17.987639 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:17.987596    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-workload-certs\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:18.089008 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.088917    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-workload-socket\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:18.089008 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.088989    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-podinfo\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:18.089234 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.089027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-token\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:18.089234 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.089074    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c76gg\" (UniqueName: \"kubernetes.io/projected/7bc96fce-f061-41fc-9631-5bc5dc8ec029-kube-api-access-c76gg\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:18.089234 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.089119    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-data\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:18.089234 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.089153    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-workload-certs\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:18.089234 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.089204    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-credential-socket\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:18.089488 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.089251    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istiod-ca-cert\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:18.089488 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.089309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-envoy\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:18.089488 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.089386    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-workload-socket\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:18.089641 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.089623    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-data\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:18.090033 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.089983    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-credential-socket\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:18.090392 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.090364    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istiod-ca-cert\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:18.090509 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.090492    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-workload-certs\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:18.092204 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.092183    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-podinfo\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:18.092204 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.092196    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-envoy\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:18.110928 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.110897    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c76gg\" (UniqueName: \"kubernetes.io/projected/7bc96fce-f061-41fc-9631-5bc5dc8ec029-kube-api-access-c76gg\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:18.112945 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.112923    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-token\") pod \"e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") " pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:18.153909 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.153873    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:18.289227 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.288923    2579 patch_prober.go:28] interesting pod/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 17:58:18.289227 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.288989    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw" podUID="5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 17:58:18.451610 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.450466    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"]
Sep 11 17:58:18.454250 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:58:18.454213    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bc96fce_f061_41fc_9631_5bc5dc8ec029.slice/crio-24cce2ad0da959ec4b59e4e3cf014df01dc5dd240c8375aea197000cccb258c7 WatchSource:0}: Error finding container 24cce2ad0da959ec4b59e4e3cf014df01dc5dd240c8375aea197000cccb258c7: Status 404 returned error can't find the container with id 24cce2ad0da959ec4b59e4e3cf014df01dc5dd240c8375aea197000cccb258c7
Sep 11 17:58:18.457248 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.457200    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:18.457359 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.457296    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:18.457359 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:18.457343    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:19.350565 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:19.350102    2579 generic.go:356] "Generic (PLEG): container finished" podID="5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" containerID="5459b8b59c5672cfcdc3fa6dfda11f812ce58423cec1f4e67d776019d4250858" exitCode=0
Sep 11 17:58:19.350565 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:19.350139    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw" event={"ID":"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372","Type":"ContainerDied","Data":"5459b8b59c5672cfcdc3fa6dfda11f812ce58423cec1f4e67d776019d4250858"}
Sep 11 17:58:19.351319 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:19.350653    2579 scope.go:117] "RemoveContainer" containerID="5459b8b59c5672cfcdc3fa6dfda11f812ce58423cec1f4e67d776019d4250858"
Sep 11 17:58:19.353127 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:19.352530    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf" event={"ID":"7bc96fce-f061-41fc-9631-5bc5dc8ec029","Type":"ContainerStarted","Data":"f05ddab508d8df73566588f0c45709894c35cd272123389163d90c27be5c09d0"}
Sep 11 17:58:19.353127 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:19.352577    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf" event={"ID":"7bc96fce-f061-41fc-9631-5bc5dc8ec029","Type":"ContainerStarted","Data":"24cce2ad0da959ec4b59e4e3cf014df01dc5dd240c8375aea197000cccb258c7"}
Sep 11 17:58:19.353292 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:19.353147    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:19.353292 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:19.353233    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:19.353292 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:19.353277    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:19.460810 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:19.460713    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf" podStartSLOduration=2.460689317 podStartE2EDuration="2.460689317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:58:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:58:19.460659701 +0000 UTC m=+792.386611448" watchObservedRunningTime="2026-09-11 17:58:19.460689317 +0000 UTC m=+792.386641065"
Sep 11 17:58:20.154668 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:20.154624    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:20.159390 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:20.159363    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:20.360537 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:20.360504    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw" event={"ID":"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372","Type":"ContainerStarted","Data":"2865a713d7fc9f11f133c823c718a6c48957b82ca046cb9342bfbb2b78bcce3c"}
Sep 11 17:58:20.360978 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:20.360918    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:20.361981 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:20.361959    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:20.885057 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:20.885022    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:58:20.885282 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:20.885199    2579 patch_prober.go:28] interesting pod/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 11 17:58:20.885282 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:20.885267    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw" podUID="5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 11 17:58:21.885619 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:21.885582    2579 patch_prober.go:28] interesting pod/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 11 17:58:21.886031 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:21.885648    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw" podUID="5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 11 17:58:22.885695 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:22.885657    2579 patch_prober.go:28] interesting pod/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 11 17:58:22.886087 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:22.885728    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw" podUID="5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 11 17:58:23.885465 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:23.885428    2579 patch_prober.go:28] interesting pod/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 11 17:58:23.885655 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:23.885480    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw" podUID="5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 11 17:58:24.885606 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:24.885567    2579 patch_prober.go:28] interesting pod/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 11 17:58:24.886005 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:24.885643    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw" podUID="5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 11 17:58:25.885445 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:25.885410    2579 patch_prober.go:28] interesting pod/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 11 17:58:25.885626 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:25.885467    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw" podUID="5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 11 17:58:26.896922 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:26.896004    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:58:26.896922 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:26.896862    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:58:26.898464 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:26.898399    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 17:58:27.345922 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:27.345882    2579 patch_prober.go:28] interesting pod/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 17:58:27.346132 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:27.345942    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz" podUID="6a89401a-cd21-48ae-af46-15729267940f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 17:58:30.429199 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:30.429120    2579 generic.go:356] "Generic (PLEG): container finished" podID="6a89401a-cd21-48ae-af46-15729267940f" containerID="18c175b9c698d5335eeacc4d3be12f2401883db5e0aa2f7ab3bf4d372630c360" exitCode=0
Sep 11 17:58:30.429199 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:30.429194    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz" event={"ID":"6a89401a-cd21-48ae-af46-15729267940f","Type":"ContainerDied","Data":"18c175b9c698d5335eeacc4d3be12f2401883db5e0aa2f7ab3bf4d372630c360"}
Sep 11 17:58:30.429691 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:30.429585    2579 scope.go:117] "RemoveContainer" containerID="18c175b9c698d5335eeacc4d3be12f2401883db5e0aa2f7ab3bf4d372630c360"
Sep 11 17:58:30.430946 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:30.430915    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:30.431067 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:30.431000    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:30.431067 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:30.431049    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:31.362890 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:31.362848    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f412cf1d-pvtq4"]
Sep 11 17:58:31.366022 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:31.366003    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f412cf1d-pvtq4"
Sep 11 17:58:31.368312 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:31.368284    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 17:58:31.368312 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:31.368288    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 17:58:31.374743 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:31.374721    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f412cf1d-pvtq4"]
Sep 11 17:58:31.438035 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:31.437992    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz" event={"ID":"6a89401a-cd21-48ae-af46-15729267940f","Type":"ContainerStarted","Data":"161e8fc2b86fd39e153eb1220d45170f39100817d9b93bde884655f11c163fed"}
Sep 11 17:58:31.461635 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:31.461594    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3876da9-e0b4-44a7-a7bd-49416ea64461-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f412cf1d-pvtq4\" (UID: \"e3876da9-e0b4-44a7-a7bd-49416ea64461\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f412cf1d-pvtq4"
Sep 11 17:58:31.563045 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:31.563007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3876da9-e0b4-44a7-a7bd-49416ea64461-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f412cf1d-pvtq4\" (UID: \"e3876da9-e0b4-44a7-a7bd-49416ea64461\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f412cf1d-pvtq4"
Sep 11 17:58:31.563668 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:31.563645    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3876da9-e0b4-44a7-a7bd-49416ea64461-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f412cf1d-pvtq4\" (UID: \"e3876da9-e0b4-44a7-a7bd-49416ea64461\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f412cf1d-pvtq4"
Sep 11 17:58:31.679575 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:31.679485    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f412cf1d-pvtq4"
Sep 11 17:58:31.802615 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:31.802145    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:31.802615 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:31.802293    2579 patch_prober.go:28] interesting pod/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 17:58:31.802615 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:31.802336    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz" podUID="6a89401a-cd21-48ae-af46-15729267940f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 17:58:31.997807 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:31.997453    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f412cf1d-pvtq4"]
Sep 11 17:58:32.444966 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:32.444878    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f412cf1d-pvtq4" event={"ID":"e3876da9-e0b4-44a7-a7bd-49416ea64461","Type":"ContainerStarted","Data":"c746d24a377fc0953b4459c472ff85d0eb86321aa25d59cc147634e64cdbcaf8"}
Sep 11 17:58:32.798593 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:32.798155    2579 patch_prober.go:28] interesting pod/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 17:58:32.798593 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:32.798218    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz" podUID="6a89401a-cd21-48ae-af46-15729267940f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 17:58:33.798654 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:33.798190    2579 patch_prober.go:28] interesting pod/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 17:58:33.798654 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:33.798254    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz" podUID="6a89401a-cd21-48ae-af46-15729267940f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 17:58:34.799626 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:34.799174    2579 patch_prober.go:28] interesting pod/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 17:58:34.799626 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:34.799240    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz" podUID="6a89401a-cd21-48ae-af46-15729267940f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 17:58:35.465538 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:35.465512    2579 generic.go:356] "Generic (PLEG): container finished" podID="bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" containerID="aa865fc0fbcb306605ca02a97bd50f2e7fa70266c07c39ec29e13e0eca2661a2" exitCode=0
Sep 11 17:58:35.465663 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:35.465579    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5" event={"ID":"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207","Type":"ContainerDied","Data":"aa865fc0fbcb306605ca02a97bd50f2e7fa70266c07c39ec29e13e0eca2661a2"}
Sep 11 17:58:35.466142 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:35.466049    2579 scope.go:117] "RemoveContainer" containerID="aa865fc0fbcb306605ca02a97bd50f2e7fa70266c07c39ec29e13e0eca2661a2"
Sep 11 17:58:35.467331 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:35.467304    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:35.467406 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:35.467378    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:35.467449 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:35.467424    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:35.798234 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:35.798137    2579 patch_prober.go:28] interesting pod/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 17:58:35.798234 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:35.798208    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz" podUID="6a89401a-cd21-48ae-af46-15729267940f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 17:58:36.472615 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:36.472569    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f412cf1d-pvtq4" event={"ID":"e3876da9-e0b4-44a7-a7bd-49416ea64461","Type":"ContainerStarted","Data":"d9faa57eee644ad905921a859318a6c55dc93b3b35b3f7d533247bd14a690785"}
Sep 11 17:58:36.475289 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:36.475261    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5" event={"ID":"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207","Type":"ContainerStarted","Data":"4bacba0ab3eb34a056b00ef5c7fa66635e2a4148e132c4caaa10a7ae2187334d"}
Sep 11 17:58:36.490908 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:36.490846    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f412cf1d-pvtq4" podStartSLOduration=2.059411105 podStartE2EDuration="5.490824758s" totalImagesPullingTime="3.431413653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:58:36.489371715 +0000 UTC m=+809.415323464" watchObservedRunningTime="2026-09-11 17:58:36.490824758 +0000 UTC m=+809.416776527"
Sep 11 17:58:36.820299 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:36.820261    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:36.820877 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:36.820813    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:36.826361 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:36.826338    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 17:58:37.343966 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:37.343928    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:37.345191 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:37.345153    2579 patch_prober.go:28] interesting pod/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 11 17:58:37.345332 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:37.345211    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5" podUID="bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 11 17:58:37.482387 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:37.482345    2579 generic.go:356] "Generic (PLEG): container finished" podID="e3876da9-e0b4-44a7-a7bd-49416ea64461" containerID="d9faa57eee644ad905921a859318a6c55dc93b3b35b3f7d533247bd14a690785" exitCode=0
Sep 11 17:58:37.482792 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:37.482360    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f412cf1d-pvtq4" event={"ID":"e3876da9-e0b4-44a7-a7bd-49416ea64461","Type":"ContainerDied","Data":"d9faa57eee644ad905921a859318a6c55dc93b3b35b3f7d533247bd14a690785"}
Sep 11 17:58:38.344837 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:38.344792    2579 patch_prober.go:28] interesting pod/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 11 17:58:38.345706 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:38.345671    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5" podUID="bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 11 17:58:38.746879 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:38.746850    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f412cf1d-pvtq4"
Sep 11 17:58:38.785656 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:38.785628    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3876da9-e0b4-44a7-a7bd-49416ea64461-maas-api-service-ca\") pod \"e3876da9-e0b4-44a7-a7bd-49416ea64461\" (UID: \"e3876da9-e0b4-44a7-a7bd-49416ea64461\") "
Sep 11 17:58:38.785996 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:38.785969    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3876da9-e0b4-44a7-a7bd-49416ea64461-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e3876da9-e0b4-44a7-a7bd-49416ea64461" (UID: "e3876da9-e0b4-44a7-a7bd-49416ea64461"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:58:38.894480 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:38.894440    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3876da9-e0b4-44a7-a7bd-49416ea64461-maas-api-service-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:58:39.344227 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:39.344190    2579 patch_prober.go:28] interesting pod/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 11 17:58:39.344402 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:39.344247    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5" podUID="bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 11 17:58:39.500362 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:39.500326    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f412cf1d-pvtq4" event={"ID":"e3876da9-e0b4-44a7-a7bd-49416ea64461","Type":"ContainerDied","Data":"c746d24a377fc0953b4459c472ff85d0eb86321aa25d59cc147634e64cdbcaf8"}
Sep 11 17:58:39.500625 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:39.500606    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c746d24a377fc0953b4459c472ff85d0eb86321aa25d59cc147634e64cdbcaf8"
Sep 11 17:58:39.500830 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:39.500813    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f412cf1d-pvtq4"
Sep 11 17:58:40.297067 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:40.296144    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:40.344550 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:40.344511    2579 patch_prober.go:28] interesting pod/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 11 17:58:40.344738 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:40.344590    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5" podUID="bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 11 17:58:41.344561 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:41.344516    2579 patch_prober.go:28] interesting pod/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 11 17:58:41.345080 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:41.344571    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5" podUID="bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 11 17:58:42.349342 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:42.349247    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:42.350727 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:42.350705    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:42.421827 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:42.421789    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f412cf1d-pvtq4"]
Sep 11 17:58:42.428700 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:42.428657    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f412cf1d-pvtq4"]
Sep 11 17:58:42.561248 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:42.561207    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"]
Sep 11 17:58:43.531820 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.531788    2579 generic.go:356] "Generic (PLEG): container finished" podID="7bc96fce-f061-41fc-9631-5bc5dc8ec029" containerID="f05ddab508d8df73566588f0c45709894c35cd272123389163d90c27be5c09d0" exitCode=0
Sep 11 17:58:43.532299 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.532006    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5" podUID="bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" containerName="istio-proxy" containerID="cri-o://4bacba0ab3eb34a056b00ef5c7fa66635e2a4148e132c4caaa10a7ae2187334d" gracePeriod=30
Sep 11 17:58:43.534069 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.534040    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3876da9-e0b4-44a7-a7bd-49416ea64461" path="/var/lib/kubelet/pods/e3876da9-e0b4-44a7-a7bd-49416ea64461/volumes"
Sep 11 17:58:43.534330 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.534312    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf" event={"ID":"7bc96fce-f061-41fc-9631-5bc5dc8ec029","Type":"ContainerDied","Data":"f05ddab508d8df73566588f0c45709894c35cd272123389163d90c27be5c09d0"}
Sep 11 17:58:43.534853 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.534832    2579 scope.go:117] "RemoveContainer" containerID="f05ddab508d8df73566588f0c45709894c35cd272123389163d90c27be5c09d0"
Sep 11 17:58:43.536000 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.535969    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:43.536089 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.536037    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:43.536089 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.536065    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:43.816084 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.815991    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"]
Sep 11 17:58:43.816721 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.816699    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3876da9-e0b4-44a7-a7bd-49416ea64461" containerName="revoke-keys"
Sep 11 17:58:43.816819 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.816725    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3876da9-e0b4-44a7-a7bd-49416ea64461" containerName="revoke-keys"
Sep 11 17:58:43.816883 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.816860    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3876da9-e0b4-44a7-a7bd-49416ea64461" containerName="revoke-keys"
Sep 11 17:58:43.819563 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.819541    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:43.823846 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.823826    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-5d49a629-gw-openshift-default-dockercfg-9lts7\""
Sep 11 17:58:43.840820 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.840798    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"]
Sep 11 17:58:43.966667 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.966608    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-workload-certs\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:43.966887 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.966677    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-envoy\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:43.966887 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.966730    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-podinfo\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:43.966887 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.966800    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsqc5\" (UniqueName: \"kubernetes.io/projected/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-kube-api-access-bsqc5\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:43.967076 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.966899    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-workload-socket\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:43.967076 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.966923    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istiod-ca-cert\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:43.967076 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.966950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-token\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:43.967076 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.966978    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-credential-socket\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:43.967076 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:43.967047    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-data\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:44.067777 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.067671    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-workload-socket\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:44.067777 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.067704    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istiod-ca-cert\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:44.067777 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.067727    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-token\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:44.068067 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.067843    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-credential-socket\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:44.068067 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.067940    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-data\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:44.068067 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.068031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-workload-certs\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:44.068067 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.068064    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-envoy\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:44.068296 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.068104    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-podinfo\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:44.068296 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.068147    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsqc5\" (UniqueName: \"kubernetes.io/projected/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-kube-api-access-bsqc5\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:44.068296 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.068261    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-credential-socket\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:44.068296 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.068149    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-workload-socket\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:44.068296 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.068283    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-data\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:44.068584 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.068334    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-workload-certs\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:44.068584 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.068503    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istiod-ca-cert\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:44.070352 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.070330    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-envoy\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:44.070502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.070487    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-podinfo\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:44.077838 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.077815    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-token\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:44.079094 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.079065    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsqc5\" (UniqueName: \"kubernetes.io/projected/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-kube-api-access-bsqc5\") pod \"e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") " pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:44.130291 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.130250    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:44.433438 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.433412    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"]
Sep 11 17:58:44.435694 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:58:44.435660    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a6f366b_df3d_418d_a3e4_9f1f8a2ef525.slice/crio-d036f036c603f5e7f8b99c864852c9dee96b21ecb79fc725aa729c700fa15c43 WatchSource:0}: Error finding container d036f036c603f5e7f8b99c864852c9dee96b21ecb79fc725aa729c700fa15c43: Status 404 returned error can't find the container with id d036f036c603f5e7f8b99c864852c9dee96b21ecb79fc725aa729c700fa15c43
Sep 11 17:58:44.438247 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.438216    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:44.438329 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.438294    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:44.438329 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.438324    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:58:44.539940 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.539909    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf" event={"ID":"7bc96fce-f061-41fc-9631-5bc5dc8ec029","Type":"ContainerStarted","Data":"af4f48e29b2b14ab808aac0232ce308091cda9277957aac9edc75dec197a11bd"}
Sep 11 17:58:44.541742 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.541709    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l" event={"ID":"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525","Type":"ContainerStarted","Data":"366bad2f70d3ea370beebf92d11077d001c2f7c3b79bc72a59d1dc86eea1a1dc"}
Sep 11 17:58:44.541901 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.541770    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l" event={"ID":"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525","Type":"ContainerStarted","Data":"d036f036c603f5e7f8b99c864852c9dee96b21ecb79fc725aa729c700fa15c43"}
Sep 11 17:58:44.605781 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:44.604537    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l" podStartSLOduration=1.60451386 podStartE2EDuration="1.60451386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:58:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:58:44.601499777 +0000 UTC m=+817.527451523" watchObservedRunningTime="2026-09-11 17:58:44.60451386 +0000 UTC m=+817.530465623"
Sep 11 17:58:45.131349 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:45.131308    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:45.136410 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:45.136386    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:45.154836 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:45.154812    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:45.155026 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:45.155006    2579 patch_prober.go:28] interesting pod/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 17:58:45.155071 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:45.155047    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf" podUID="7bc96fce-f061-41fc-9631-5bc5dc8ec029" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 17:58:45.547245 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:45.547210    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:45.548218 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:45.548197    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:58:46.154382 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:46.154346    2579 patch_prober.go:28] interesting pod/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 17:58:46.154549 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:46.154401    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf" podUID="7bc96fce-f061-41fc-9631-5bc5dc8ec029" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 17:58:47.154505 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:47.154469    2579 patch_prober.go:28] interesting pod/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 17:58:47.154917 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:47.154520    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf" podUID="7bc96fce-f061-41fc-9631-5bc5dc8ec029" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 17:58:48.155059 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.155024    2579 patch_prober.go:28] interesting pod/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 17:58:48.155485 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.155077    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf" podUID="7bc96fce-f061-41fc-9631-5bc5dc8ec029" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 17:58:48.836826 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.836804    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:48.926228 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.926193    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-data\") pod \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") "
Sep 11 17:58:48.926399 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.926243    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-token\") pod \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") "
Sep 11 17:58:48.926399 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.926306    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-envoy\") pod \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") "
Sep 11 17:58:48.926524 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.926404    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istiod-ca-cert\") pod \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") "
Sep 11 17:58:48.926524 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.926450    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-credential-socket\") pod \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") "
Sep 11 17:58:48.926524 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.926476    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-podinfo\") pod \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") "
Sep 11 17:58:48.926524 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.926498    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-data" (OuterVolumeSpecName: "istio-data") pod "bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" (UID: "bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:58:48.926733 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.926513    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g42t2\" (UniqueName: \"kubernetes.io/projected/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-kube-api-access-g42t2\") pod \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") "
Sep 11 17:58:48.926733 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.926634    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-workload-socket\") pod \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") "
Sep 11 17:58:48.926733 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.926691    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-workload-certs\") pod \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\" (UID: \"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207\") "
Sep 11 17:58:48.926878 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.926796    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" (UID: "bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:58:48.926878 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.926842    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" (UID: "bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:58:48.927032 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.927009    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" (UID: "bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:58:48.927163 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.927147    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-credential-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:58:48.927223 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.927169    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-workload-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:58:48.927223 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.927184    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-workload-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:58:48.927223 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.927197    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-data\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:58:48.927388 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.927231    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" (UID: "bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:58:48.928931 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.928899    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-token" (OuterVolumeSpecName: "istio-token") pod "bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" (UID: "bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:58:48.929035 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.928960    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-kube-api-access-g42t2" (OuterVolumeSpecName: "kube-api-access-g42t2") pod "bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" (UID: "bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207"). InnerVolumeSpecName "kube-api-access-g42t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:58:48.929168 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.929148    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" (UID: "bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:58:48.929369 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:48.929343    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" (UID: "bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 17:58:49.028527 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:49.028483    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g42t2\" (UniqueName: \"kubernetes.io/projected/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-kube-api-access-g42t2\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:58:49.028527 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:49.028520    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-token\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:58:49.028527 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:49.028531    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-envoy\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:58:49.028791 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:49.028540    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istiod-ca-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:58:49.028791 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:49.028549    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207-istio-podinfo\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:58:49.154663 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:49.154559    2579 patch_prober.go:28] interesting pod/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 17:58:49.154663 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:49.154638    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf" podUID="7bc96fce-f061-41fc-9631-5bc5dc8ec029" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 17:58:49.573074 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:49.573038    2579 generic.go:356] "Generic (PLEG): container finished" podID="bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" containerID="4bacba0ab3eb34a056b00ef5c7fa66635e2a4148e132c4caaa10a7ae2187334d" exitCode=0
Sep 11 17:58:49.573442 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:49.573089    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"
Sep 11 17:58:49.573442 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:49.573123    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5" event={"ID":"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207","Type":"ContainerDied","Data":"4bacba0ab3eb34a056b00ef5c7fa66635e2a4148e132c4caaa10a7ae2187334d"}
Sep 11 17:58:49.573442 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:49.573195    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5" event={"ID":"bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207","Type":"ContainerDied","Data":"7dd380daee726d04dded324c405c60bf36ff62d69682881cfd47dfb27dbe466c"}
Sep 11 17:58:49.573442 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:49.573228    2579 scope.go:117] "RemoveContainer" containerID="4bacba0ab3eb34a056b00ef5c7fa66635e2a4148e132c4caaa10a7ae2187334d"
Sep 11 17:58:49.585313 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:49.585293    2579 scope.go:117] "RemoveContainer" containerID="aa865fc0fbcb306605ca02a97bd50f2e7fa70266c07c39ec29e13e0eca2661a2"
Sep 11 17:58:49.594920 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:49.594889    2579 scope.go:117] "RemoveContainer" containerID="4bacba0ab3eb34a056b00ef5c7fa66635e2a4148e132c4caaa10a7ae2187334d"
Sep 11 17:58:49.595418 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:58:49.595391    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bacba0ab3eb34a056b00ef5c7fa66635e2a4148e132c4caaa10a7ae2187334d\": container with ID starting with 4bacba0ab3eb34a056b00ef5c7fa66635e2a4148e132c4caaa10a7ae2187334d not found: ID does not exist" containerID="4bacba0ab3eb34a056b00ef5c7fa66635e2a4148e132c4caaa10a7ae2187334d"
Sep 11 17:58:49.595495 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:49.595430    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bacba0ab3eb34a056b00ef5c7fa66635e2a4148e132c4caaa10a7ae2187334d"} err="failed to get container status \"4bacba0ab3eb34a056b00ef5c7fa66635e2a4148e132c4caaa10a7ae2187334d\": rpc error: code = NotFound desc = could not find container \"4bacba0ab3eb34a056b00ef5c7fa66635e2a4148e132c4caaa10a7ae2187334d\": container with ID starting with 4bacba0ab3eb34a056b00ef5c7fa66635e2a4148e132c4caaa10a7ae2187334d not found: ID does not exist"
Sep 11 17:58:49.595495 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:49.595454    2579 scope.go:117] "RemoveContainer" containerID="aa865fc0fbcb306605ca02a97bd50f2e7fa70266c07c39ec29e13e0eca2661a2"
Sep 11 17:58:49.595737 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:58:49.595717    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa865fc0fbcb306605ca02a97bd50f2e7fa70266c07c39ec29e13e0eca2661a2\": container with ID starting with aa865fc0fbcb306605ca02a97bd50f2e7fa70266c07c39ec29e13e0eca2661a2 not found: ID does not exist" containerID="aa865fc0fbcb306605ca02a97bd50f2e7fa70266c07c39ec29e13e0eca2661a2"
Sep 11 17:58:49.595802 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:49.595744    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa865fc0fbcb306605ca02a97bd50f2e7fa70266c07c39ec29e13e0eca2661a2"} err="failed to get container status \"aa865fc0fbcb306605ca02a97bd50f2e7fa70266c07c39ec29e13e0eca2661a2\": rpc error: code = NotFound desc = could not find container \"aa865fc0fbcb306605ca02a97bd50f2e7fa70266c07c39ec29e13e0eca2661a2\": container with ID starting with aa865fc0fbcb306605ca02a97bd50f2e7fa70266c07c39ec29e13e0eca2661a2 not found: ID does not exist"
Sep 11 17:58:49.596325 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:49.596307    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"]
Sep 11 17:58:49.605084 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:49.605063    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5"]
Sep 11 17:58:50.158879 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:50.158847    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:50.159133 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:50.159111    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:50.159836 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:50.159812    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 17:58:51.534751 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:58:51.534717    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" path="/var/lib/kubelet/pods/bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207/volumes"
Sep 11 17:59:09.280917 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:09.280881    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5d49a629-smvwv"]
Sep 11 17:59:09.281351 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:09.281331    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" containerName="istio-proxy"
Sep 11 17:59:09.281351 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:09.281351    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" containerName="istio-proxy"
Sep 11 17:59:09.281434 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:09.281363    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" containerName="istio-proxy"
Sep 11 17:59:09.281434 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:09.281370    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" containerName="istio-proxy"
Sep 11 17:59:09.281495 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:09.281437    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" containerName="istio-proxy"
Sep 11 17:59:09.281495 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:09.281445    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd0fcc4a-19cc-46d4-8b2c-6e7f8673c207" containerName="istio-proxy"
Sep 11 17:59:09.284285 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:09.284270    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5d49a629-smvwv"
Sep 11 17:59:09.286885 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:09.286865    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 17:59:09.288058 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:09.288037    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 17:59:09.305827 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:09.305800    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5d49a629-smvwv"]
Sep 11 17:59:09.330796 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:09.330753    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5d49a629-smvwv\" (UID: \"84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5d49a629-smvwv"
Sep 11 17:59:09.432339 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:09.432307    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5d49a629-smvwv\" (UID: \"84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5d49a629-smvwv"
Sep 11 17:59:09.433038 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:09.433012    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5d49a629-smvwv\" (UID: \"84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5d49a629-smvwv"
Sep 11 17:59:09.598406 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:09.598313    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5d49a629-smvwv"
Sep 11 17:59:09.879838 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:09.879809    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5d49a629-smvwv"]
Sep 11 17:59:09.881506 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:59:09.881480    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84405ec0_0f3c_446a_97d0_3ddb4bd5e9b9.slice/crio-4acde7700de72b44286b42ebd6a6644ef2652712e86026d625db6673d3f376b2 WatchSource:0}: Error finding container 4acde7700de72b44286b42ebd6a6644ef2652712e86026d625db6673d3f376b2: Status 404 returned error can't find the container with id 4acde7700de72b44286b42ebd6a6644ef2652712e86026d625db6673d3f376b2
Sep 11 17:59:10.696666 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:10.696624    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5d49a629-smvwv" event={"ID":"84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9","Type":"ContainerStarted","Data":"2ebeb42ab0cd83f4fac9e79c94f3d9ea5b1b25aea8a2b71b29a21bb38425ec86"}
Sep 11 17:59:10.697168 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:10.696698    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5d49a629-smvwv" event={"ID":"84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9","Type":"ContainerStarted","Data":"4acde7700de72b44286b42ebd6a6644ef2652712e86026d625db6673d3f376b2"}
Sep 11 17:59:11.703817 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:11.703782    2579 generic.go:356] "Generic (PLEG): container finished" podID="84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9" containerID="2ebeb42ab0cd83f4fac9e79c94f3d9ea5b1b25aea8a2b71b29a21bb38425ec86" exitCode=0
Sep 11 17:59:11.704209 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:11.703903    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5d49a629-smvwv" event={"ID":"84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9","Type":"ContainerDied","Data":"2ebeb42ab0cd83f4fac9e79c94f3d9ea5b1b25aea8a2b71b29a21bb38425ec86"}
Sep 11 17:59:12.851572 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:12.851532    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5d49a629-smvwv"
Sep 11 17:59:12.965153 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:12.965071    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9-maas-api-service-ca\") pod \"84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9\" (UID: \"84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9\") "
Sep 11 17:59:12.965450 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:12.965425    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9" (UID: "84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:59:13.066636 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:13.066600    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9-maas-api-service-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:59:13.715345 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:13.715312    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5d49a629-smvwv" event={"ID":"84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9","Type":"ContainerDied","Data":"4acde7700de72b44286b42ebd6a6644ef2652712e86026d625db6673d3f376b2"}
Sep 11 17:59:13.715345 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:13.715338    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5d49a629-smvwv"
Sep 11 17:59:13.715551 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:13.715363    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4acde7700de72b44286b42ebd6a6644ef2652712e86026d625db6673d3f376b2"
Sep 11 17:59:14.722118 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:14.722084    2579 generic.go:356] "Generic (PLEG): container finished" podID="6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" containerID="366bad2f70d3ea370beebf92d11077d001c2f7c3b79bc72a59d1dc86eea1a1dc" exitCode=0
Sep 11 17:59:14.722514 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:14.722154    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l" event={"ID":"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525","Type":"ContainerDied","Data":"366bad2f70d3ea370beebf92d11077d001c2f7c3b79bc72a59d1dc86eea1a1dc"}
Sep 11 17:59:14.722558 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:14.722544    2579 scope.go:117] "RemoveContainer" containerID="366bad2f70d3ea370beebf92d11077d001c2f7c3b79bc72a59d1dc86eea1a1dc"
Sep 11 17:59:14.723617 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:14.723590    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:59:14.723700 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:14.723685    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:59:14.723737 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:14.723723    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:59:15.547866 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:15.547839    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:59:15.729973 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:15.729936    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l" event={"ID":"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525","Type":"ContainerStarted","Data":"ab4a0d68bbe3cbf1e4de2e5aa8954c3fffc5b108bab0cc2ed3d89428b42809d5"}
Sep 11 17:59:16.131408 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:16.131375    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:59:16.132667 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:16.132641    2579 patch_prober.go:28] interesting pod/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 11 17:59:16.132802 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:16.132703    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l" podUID="6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 11 17:59:17.131581 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:17.131545    2579 patch_prober.go:28] interesting pod/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 11 17:59:17.132076 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:17.131610    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l" podUID="6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 11 17:59:18.130700 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:18.130667    2579 patch_prober.go:28] interesting pod/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 11 17:59:18.130882 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:18.130724    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l" podUID="6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 11 17:59:18.203241 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:18.202075    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5d49a629-smvwv"]
Sep 11 17:59:18.207427 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:18.207401    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5d49a629-smvwv"]
Sep 11 17:59:18.344593 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:18.344555    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"]
Sep 11 17:59:18.749884 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:18.749823    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l" podUID="6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" containerName="istio-proxy" containerID="cri-o://ab4a0d68bbe3cbf1e4de2e5aa8954c3fffc5b108bab0cc2ed3d89428b42809d5" gracePeriod=30
Sep 11 17:59:19.216786 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.216683    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"]
Sep 11 17:59:19.217988 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.217961    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9" containerName="revoke-keys"
Sep 11 17:59:19.218139 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.218125    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9" containerName="revoke-keys"
Sep 11 17:59:19.218376 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.218360    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9" containerName="revoke-keys"
Sep 11 17:59:19.222412 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.222393    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.225722 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.225704    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e436a33c-openshift-default-dockercfg-g8ctp\""
Sep 11 17:59:19.236290 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.236268    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"]
Sep 11 17:59:19.338230 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.338195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-data\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.338502 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.338475    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-workload-socket\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.338692 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.338673    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-credential-socket\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.338881 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.338864    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-podinfo\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.339044 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.339028    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-envoy\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.339183 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.339168    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5phh\" (UniqueName: \"kubernetes.io/projected/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-kube-api-access-c5phh\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.339350 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.339335    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-token\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.339496 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.339478    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istiod-ca-cert\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.339601 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.339579    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-workload-certs\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.441155 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.441119    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-data\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.441155 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.441157    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-workload-socket\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.441403 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.441214    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-credential-socket\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.441403 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.441254    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-podinfo\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.441403 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.441283    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-envoy\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.441403 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.441309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5phh\" (UniqueName: \"kubernetes.io/projected/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-kube-api-access-c5phh\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.441619 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.441573    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-data\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.441619 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.441593    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-workload-socket\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.441724 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.441643    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-credential-socket\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.441724 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.441716    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-token\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.441844 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.441735    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istiod-ca-cert\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.441844 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.441798    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-workload-certs\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.442133 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.442113    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-workload-certs\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.442348 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.442331    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istiod-ca-cert\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.444071 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.444045    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-envoy\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.444375 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.444353    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-podinfo\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.464613 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.464591    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-token\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.495812 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.495778    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5phh\" (UniqueName: \"kubernetes.io/projected/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-kube-api-access-c5phh\") pod \"e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") " pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.534223 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.534190    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:19.534427 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.534344    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9" path="/var/lib/kubelet/pods/84405ec0-0f3c-446a-97d0-3ddb4bd5e9b9/volumes"
Sep 11 17:59:19.845607 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.845577    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"]
Sep 11 17:59:19.847350 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:59:19.847327    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d89eb0_36c4_4bf7_993f_5ec71e2acfe7.slice/crio-a1390f33fb8523dc72d7377b5312523a2faa8a3c9cbc418014bbdacf45e1122f WatchSource:0}: Error finding container a1390f33fb8523dc72d7377b5312523a2faa8a3c9cbc418014bbdacf45e1122f: Status 404 returned error can't find the container with id a1390f33fb8523dc72d7377b5312523a2faa8a3c9cbc418014bbdacf45e1122f
Sep 11 17:59:19.849427 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.849399    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:59:19.849473 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.849459    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:59:19.849504 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:19.849485    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:59:20.762095 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:20.762060    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm" event={"ID":"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7","Type":"ContainerStarted","Data":"9cf8527bf6a655619bcc4ea8c55826fe4ccaa8fc4dad88a350b8a1abaf01e2e4"}
Sep 11 17:59:20.762469 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:20.762112    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm" event={"ID":"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7","Type":"ContainerStarted","Data":"a1390f33fb8523dc72d7377b5312523a2faa8a3c9cbc418014bbdacf45e1122f"}
Sep 11 17:59:21.534443 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:21.534412    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:21.539204 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:21.539182    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:21.572138 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:21.572083    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm" podStartSLOduration=2.572066266 podStartE2EDuration="2.572066266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:59:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:59:20.799193885 +0000 UTC m=+853.725145633" watchObservedRunningTime="2026-09-11 17:59:21.572066266 +0000 UTC m=+854.498018011"
Sep 11 17:59:21.767337 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:21.767306    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:21.768211 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:21.768187    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:26.313259 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.313232    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:59:26.418062 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.417982    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-envoy\") pod \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") "
Sep 11 17:59:26.418062 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.418053    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-token\") pod \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") "
Sep 11 17:59:26.418246 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.418090    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsqc5\" (UniqueName: \"kubernetes.io/projected/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-kube-api-access-bsqc5\") pod \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") "
Sep 11 17:59:26.418246 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.418133    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-podinfo\") pod \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") "
Sep 11 17:59:26.418246 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.418161    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istiod-ca-cert\") pod \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") "
Sep 11 17:59:26.418246 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.418194    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-credential-socket\") pod \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") "
Sep 11 17:59:26.418456 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.418251    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-workload-socket\") pod \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") "
Sep 11 17:59:26.418456 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.418305    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-workload-certs\") pod \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") "
Sep 11 17:59:26.418456 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.418354    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-data\") pod \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\" (UID: \"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525\") "
Sep 11 17:59:26.418610 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.418534    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" (UID: "6a6f366b-df3d-418d-a3e4-9f1f8a2ef525"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:59:26.418674 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.418600    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" (UID: "6a6f366b-df3d-418d-a3e4-9f1f8a2ef525"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:59:26.418753 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.418723    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" (UID: "6a6f366b-df3d-418d-a3e4-9f1f8a2ef525"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:59:26.418844 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.418782    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" (UID: "6a6f366b-df3d-418d-a3e4-9f1f8a2ef525"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:59:26.418903 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.418870    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-workload-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:59:26.418903 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.418889    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istiod-ca-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:59:26.419003 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.418903    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-credential-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:59:26.419003 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.418918    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-workload-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:59:26.419003 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.418957    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-data" (OuterVolumeSpecName: "istio-data") pod "6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" (UID: "6a6f366b-df3d-418d-a3e4-9f1f8a2ef525"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:59:26.420323 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.420204    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" (UID: "6a6f366b-df3d-418d-a3e4-9f1f8a2ef525"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:59:26.420458 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.420400    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-token" (OuterVolumeSpecName: "istio-token") pod "6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" (UID: "6a6f366b-df3d-418d-a3e4-9f1f8a2ef525"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:59:26.420669 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.420647    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" (UID: "6a6f366b-df3d-418d-a3e4-9f1f8a2ef525"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 17:59:26.420916 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.420899    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-kube-api-access-bsqc5" (OuterVolumeSpecName: "kube-api-access-bsqc5") pod "6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" (UID: "6a6f366b-df3d-418d-a3e4-9f1f8a2ef525"). InnerVolumeSpecName "kube-api-access-bsqc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:59:26.520049 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.520015    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-data\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:59:26.520049 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.520043    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-envoy\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:59:26.520049 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.520053    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-token\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:59:26.520278 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.520063    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsqc5\" (UniqueName: \"kubernetes.io/projected/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-kube-api-access-bsqc5\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:59:26.520278 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.520073    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525-istio-podinfo\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:59:26.797738 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.797702    2579 generic.go:356] "Generic (PLEG): container finished" podID="6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" containerID="ab4a0d68bbe3cbf1e4de2e5aa8954c3fffc5b108bab0cc2ed3d89428b42809d5" exitCode=0
Sep 11 17:59:26.797944 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.797754    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l" event={"ID":"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525","Type":"ContainerDied","Data":"ab4a0d68bbe3cbf1e4de2e5aa8954c3fffc5b108bab0cc2ed3d89428b42809d5"}
Sep 11 17:59:26.797944 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.797789    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"
Sep 11 17:59:26.797944 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.797825    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l" event={"ID":"6a6f366b-df3d-418d-a3e4-9f1f8a2ef525","Type":"ContainerDied","Data":"d036f036c603f5e7f8b99c864852c9dee96b21ecb79fc725aa729c700fa15c43"}
Sep 11 17:59:26.797944 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.797848    2579 scope.go:117] "RemoveContainer" containerID="ab4a0d68bbe3cbf1e4de2e5aa8954c3fffc5b108bab0cc2ed3d89428b42809d5"
Sep 11 17:59:26.807139 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.807120    2579 scope.go:117] "RemoveContainer" containerID="366bad2f70d3ea370beebf92d11077d001c2f7c3b79bc72a59d1dc86eea1a1dc"
Sep 11 17:59:26.815113 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.815097    2579 scope.go:117] "RemoveContainer" containerID="ab4a0d68bbe3cbf1e4de2e5aa8954c3fffc5b108bab0cc2ed3d89428b42809d5"
Sep 11 17:59:26.815407 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:59:26.815386    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab4a0d68bbe3cbf1e4de2e5aa8954c3fffc5b108bab0cc2ed3d89428b42809d5\": container with ID starting with ab4a0d68bbe3cbf1e4de2e5aa8954c3fffc5b108bab0cc2ed3d89428b42809d5 not found: ID does not exist" containerID="ab4a0d68bbe3cbf1e4de2e5aa8954c3fffc5b108bab0cc2ed3d89428b42809d5"
Sep 11 17:59:26.815460 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.815417    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab4a0d68bbe3cbf1e4de2e5aa8954c3fffc5b108bab0cc2ed3d89428b42809d5"} err="failed to get container status \"ab4a0d68bbe3cbf1e4de2e5aa8954c3fffc5b108bab0cc2ed3d89428b42809d5\": rpc error: code = NotFound desc = could not find container \"ab4a0d68bbe3cbf1e4de2e5aa8954c3fffc5b108bab0cc2ed3d89428b42809d5\": container with ID starting with ab4a0d68bbe3cbf1e4de2e5aa8954c3fffc5b108bab0cc2ed3d89428b42809d5 not found: ID does not exist"
Sep 11 17:59:26.815460 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.815436    2579 scope.go:117] "RemoveContainer" containerID="366bad2f70d3ea370beebf92d11077d001c2f7c3b79bc72a59d1dc86eea1a1dc"
Sep 11 17:59:26.815670 ip-10-0-140-211 kubenswrapper[2579]: E0911 17:59:26.815649    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"366bad2f70d3ea370beebf92d11077d001c2f7c3b79bc72a59d1dc86eea1a1dc\": container with ID starting with 366bad2f70d3ea370beebf92d11077d001c2f7c3b79bc72a59d1dc86eea1a1dc not found: ID does not exist" containerID="366bad2f70d3ea370beebf92d11077d001c2f7c3b79bc72a59d1dc86eea1a1dc"
Sep 11 17:59:26.815720 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.815680    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"366bad2f70d3ea370beebf92d11077d001c2f7c3b79bc72a59d1dc86eea1a1dc"} err="failed to get container status \"366bad2f70d3ea370beebf92d11077d001c2f7c3b79bc72a59d1dc86eea1a1dc\": rpc error: code = NotFound desc = could not find container \"366bad2f70d3ea370beebf92d11077d001c2f7c3b79bc72a59d1dc86eea1a1dc\": container with ID starting with 366bad2f70d3ea370beebf92d11077d001c2f7c3b79bc72a59d1dc86eea1a1dc not found: ID does not exist"
Sep 11 17:59:26.854413 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.854381    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"]
Sep 11 17:59:26.856476 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:26.856454    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l"]
Sep 11 17:59:27.536193 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:27.536161    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" path="/var/lib/kubelet/pods/6a6f366b-df3d-418d-a3e4-9f1f8a2ef525/volumes"
Sep 11 17:59:40.880139 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:40.880102    2579 generic.go:356] "Generic (PLEG): container finished" podID="98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" containerID="9cf8527bf6a655619bcc4ea8c55826fe4ccaa8fc4dad88a350b8a1abaf01e2e4" exitCode=0
Sep 11 17:59:40.880577 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:40.880172    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm" event={"ID":"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7","Type":"ContainerDied","Data":"9cf8527bf6a655619bcc4ea8c55826fe4ccaa8fc4dad88a350b8a1abaf01e2e4"}
Sep 11 17:59:40.880620 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:40.880593    2579 scope.go:117] "RemoveContainer" containerID="9cf8527bf6a655619bcc4ea8c55826fe4ccaa8fc4dad88a350b8a1abaf01e2e4"
Sep 11 17:59:40.881667 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:40.881642    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:59:40.881720 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:40.881703    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:59:40.881782 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:40.881732    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:59:41.889912 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:41.888950    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm" event={"ID":"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7","Type":"ContainerStarted","Data":"3594843f37ed8d7371a98d6a7cbf1150553275a70256886e5a7320c7910759f6"}
Sep 11 17:59:42.534835 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:42.534791    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:42.535095 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:42.535059    2579 patch_prober.go:28] interesting pod/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 11 17:59:42.535190 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:42.535123    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm" podUID="98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 11 17:59:43.535373 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:43.535335    2579 patch_prober.go:28] interesting pod/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 11 17:59:43.535741 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:43.535389    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm" podUID="98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 11 17:59:44.534604 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:44.534560    2579 patch_prober.go:28] interesting pod/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 11 17:59:44.534839 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:44.534640    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm" podUID="98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 11 17:59:45.535300 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:45.535262    2579 patch_prober.go:28] interesting pod/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 11 17:59:45.535663 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:45.535329    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm" podUID="98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 11 17:59:46.534693 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:46.534660    2579 patch_prober.go:28] interesting pod/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 11 17:59:46.534887 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:46.534721    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm" podUID="98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 11 17:59:47.538665 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:47.538634    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:47.539149 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:47.538901    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:47.539640 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:47.539623    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 17:59:48.055900 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:48.055870    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e436a33c-gtzfr"]
Sep 11 17:59:48.056320 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:48.056308    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" containerName="istio-proxy"
Sep 11 17:59:48.056367 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:48.056323    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" containerName="istio-proxy"
Sep 11 17:59:48.056367 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:48.056346    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" containerName="istio-proxy"
Sep 11 17:59:48.056367 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:48.056351    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" containerName="istio-proxy"
Sep 11 17:59:48.056466 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:48.056419    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" containerName="istio-proxy"
Sep 11 17:59:48.056466 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:48.056427    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a6f366b-df3d-418d-a3e4-9f1f8a2ef525" containerName="istio-proxy"
Sep 11 17:59:48.058703 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:48.058686    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e436a33c-gtzfr"
Sep 11 17:59:48.061139 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:48.061116    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 17:59:48.061318 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:48.061302    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 17:59:48.070100 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:48.070073    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e436a33c-gtzfr"]
Sep 11 17:59:48.154428 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:48.154391    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5731ff5-baf0-4d3a-a762-6cc918860dde-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e436a33c-gtzfr\" (UID: \"b5731ff5-baf0-4d3a-a762-6cc918860dde\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e436a33c-gtzfr"
Sep 11 17:59:48.255898 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:48.255857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5731ff5-baf0-4d3a-a762-6cc918860dde-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e436a33c-gtzfr\" (UID: \"b5731ff5-baf0-4d3a-a762-6cc918860dde\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e436a33c-gtzfr"
Sep 11 17:59:48.256538 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:48.256519    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5731ff5-baf0-4d3a-a762-6cc918860dde-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e436a33c-gtzfr\" (UID: \"b5731ff5-baf0-4d3a-a762-6cc918860dde\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e436a33c-gtzfr"
Sep 11 17:59:48.369606 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:48.369522    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e436a33c-gtzfr"
Sep 11 17:59:48.642399 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:48.641349    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e436a33c-gtzfr"]
Sep 11 17:59:48.644310 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:59:48.644280    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5731ff5_baf0_4d3a_a762_6cc918860dde.slice/crio-b75190242ec39d78f1dbaa960f0098db40dfb14cf1c651a58fb3d537664efb43 WatchSource:0}: Error finding container b75190242ec39d78f1dbaa960f0098db40dfb14cf1c651a58fb3d537664efb43: Status 404 returned error can't find the container with id b75190242ec39d78f1dbaa960f0098db40dfb14cf1c651a58fb3d537664efb43
Sep 11 17:59:48.939891 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:48.939860    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e436a33c-gtzfr" event={"ID":"b5731ff5-baf0-4d3a-a762-6cc918860dde","Type":"ContainerStarted","Data":"b75190242ec39d78f1dbaa960f0098db40dfb14cf1c651a58fb3d537664efb43"}
Sep 11 17:59:49.946854 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:49.946818    2579 generic.go:356] "Generic (PLEG): container finished" podID="b5731ff5-baf0-4d3a-a762-6cc918860dde" containerID="cff4e7919be33ea99aa0e4d858a18e5414de15d3f69dcf61ba8ee8449feb6885" exitCode=0
Sep 11 17:59:49.946854 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:49.946855    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e436a33c-gtzfr" event={"ID":"b5731ff5-baf0-4d3a-a762-6cc918860dde","Type":"ContainerDied","Data":"cff4e7919be33ea99aa0e4d858a18e5414de15d3f69dcf61ba8ee8449feb6885"}
Sep 11 17:59:51.095090 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:51.095064    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e436a33c-gtzfr"
Sep 11 17:59:51.182953 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:51.182912    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5731ff5-baf0-4d3a-a762-6cc918860dde-maas-api-service-ca\") pod \"b5731ff5-baf0-4d3a-a762-6cc918860dde\" (UID: \"b5731ff5-baf0-4d3a-a762-6cc918860dde\") "
Sep 11 17:59:51.183287 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:51.183264    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5731ff5-baf0-4d3a-a762-6cc918860dde-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b5731ff5-baf0-4d3a-a762-6cc918860dde" (UID: "b5731ff5-baf0-4d3a-a762-6cc918860dde"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:59:51.284241 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:51.284207    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5731ff5-baf0-4d3a-a762-6cc918860dde-maas-api-service-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 17:59:51.958462 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:51.958376    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e436a33c-gtzfr" event={"ID":"b5731ff5-baf0-4d3a-a762-6cc918860dde","Type":"ContainerDied","Data":"b75190242ec39d78f1dbaa960f0098db40dfb14cf1c651a58fb3d537664efb43"}
Sep 11 17:59:51.958462 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:51.958395    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e436a33c-gtzfr"
Sep 11 17:59:51.958462 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:51.958424    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b75190242ec39d78f1dbaa960f0098db40dfb14cf1c651a58fb3d537664efb43"
Sep 11 17:59:54.899308 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:54.899260    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e436a33c-gtzfr"]
Sep 11 17:59:54.902703 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:54.902675    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e436a33c-gtzfr"]
Sep 11 17:59:55.540275 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:55.540239    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5731ff5-baf0-4d3a-a762-6cc918860dde" path="/var/lib/kubelet/pods/b5731ff5-baf0-4d3a-a762-6cc918860dde/volumes"
Sep 11 17:59:56.152264 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:56.152232    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"]
Sep 11 17:59:56.152636 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:56.152478    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm" podUID="98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" containerName="istio-proxy" containerID="cri-o://3594843f37ed8d7371a98d6a7cbf1150553275a70256886e5a7320c7910759f6" gracePeriod=30
Sep 11 17:59:57.124411 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.124378    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"]
Sep 11 17:59:57.124838 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.124825    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5731ff5-baf0-4d3a-a762-6cc918860dde" containerName="revoke-keys"
Sep 11 17:59:57.124892 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.124840    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5731ff5-baf0-4d3a-a762-6cc918860dde" containerName="revoke-keys"
Sep 11 17:59:57.124934 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.124924    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5731ff5-baf0-4d3a-a762-6cc918860dde" containerName="revoke-keys"
Sep 11 17:59:57.127310 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.127294    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.130217 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.130196    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-c83b88f4-openshift-default-dockercfg-47fcb\""
Sep 11 17:59:57.144887 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.144865    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"]
Sep 11 17:59:57.244064 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.244028    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-workload-socket\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.244421 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.244092    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-token\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.244421 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.244123    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkb5c\" (UniqueName: \"kubernetes.io/projected/135a0b1d-dbfb-4976-be56-0193cef1904e-kube-api-access-qkb5c\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.244421 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.244145    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/135a0b1d-dbfb-4976-be56-0193cef1904e-istiod-ca-cert\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.244421 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.244188    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-podinfo\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.244421 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.244245    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-envoy\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.244421 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.244296    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-workload-certs\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.244421 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.244350    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-credential-socket\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.244421 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.244405    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-data\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.345415 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.345380    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/135a0b1d-dbfb-4976-be56-0193cef1904e-istiod-ca-cert\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.345615 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.345446    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-podinfo\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.345615 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.345481    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-envoy\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.345615 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.345506    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-workload-certs\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.345615 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.345561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-credential-socket\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.345615 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.345594    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-data\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.345943 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.345619    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-workload-socket\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.345943 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.345678    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-token\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.345943 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.345709    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkb5c\" (UniqueName: \"kubernetes.io/projected/135a0b1d-dbfb-4976-be56-0193cef1904e-kube-api-access-qkb5c\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.346132 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.345997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-workload-certs\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.346132 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.346077    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-credential-socket\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.346259 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.346160    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-workload-socket\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.346322 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.346273    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/135a0b1d-dbfb-4976-be56-0193cef1904e-istiod-ca-cert\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.346322 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.346299    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-data\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.347874 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.347854    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-envoy\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.348091 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.348076    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-podinfo\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.360070 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.360046    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-token\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.360162 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.360107    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkb5c\" (UniqueName: \"kubernetes.io/projected/135a0b1d-dbfb-4976-be56-0193cef1904e-kube-api-access-qkb5c\") pod \"e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") " pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.464352 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.464269    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:57.743726 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.743697    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"]
Sep 11 17:59:57.745587 ip-10-0-140-211 kubenswrapper[2579]: W0911 17:59:57.745557    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod135a0b1d_dbfb_4976_be56_0193cef1904e.slice/crio-d7be1bf273800fbbc7510d3a131125e85f1d596f89fb0815ba1438ac331fb750 WatchSource:0}: Error finding container d7be1bf273800fbbc7510d3a131125e85f1d596f89fb0815ba1438ac331fb750: Status 404 returned error can't find the container with id d7be1bf273800fbbc7510d3a131125e85f1d596f89fb0815ba1438ac331fb750
Sep 11 17:59:57.747840 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.747802    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:59:57.747934 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.747889    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:59:57.747987 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.747934    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 17:59:57.996344 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.996263    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw" event={"ID":"135a0b1d-dbfb-4976-be56-0193cef1904e","Type":"ContainerStarted","Data":"407bd572479c76bc0251ac476368d31addbb2c1377421bc1f0dbc5ebe3a32d74"}
Sep 11 17:59:57.996344 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:57.996322    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw" event={"ID":"135a0b1d-dbfb-4976-be56-0193cef1904e","Type":"ContainerStarted","Data":"d7be1bf273800fbbc7510d3a131125e85f1d596f89fb0815ba1438ac331fb750"}
Sep 11 17:59:58.028141 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:58.028077    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw" podStartSLOduration=1.028055117 podStartE2EDuration="1.028055117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:59:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:59:58.027107067 +0000 UTC m=+890.953058826" watchObservedRunningTime="2026-09-11 17:59:58.028055117 +0000 UTC m=+890.954006863"
Sep 11 17:59:58.465491 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:58.465401    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:58.470484 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:58.470459    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:59.002198 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:59.002162    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 17:59:59.003154 ip-10-0-140-211 kubenswrapper[2579]: I0911 17:59:59.003130    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 18:00:00.239192 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:00.239109    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-5883b7-29819160-7679b"]
Sep 11 18:00:00.242032 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:00.242010    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-5883b7-29819160-7679b"
Sep 11 18:00:00.247330 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:00.247306    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 18:00:00.252709 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:00.252685    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-5883b7-29819160-7679b"
Sep 11 18:00:00.253930 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:00.253910    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-67477b-29819160-px78n"]
Sep 11 18:00:00.256649 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:00.256632    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-67477b-29819160-px78n"
Sep 11 18:00:00.286837 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:00.286802    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-67477b-29819160-px78n"
Sep 11 18:00:00.300363 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:00.300267    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-5883b7-29819160-7679b"]
Sep 11 18:00:00.304800 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:00.304729    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-67477b-29819160-px78n"]
Sep 11 18:00:00.548949 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:00.548919    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-5883b7-29819160-7679b"]
Sep 11 18:00:00.550724 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:00:00.550703    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod221438e5_9c77_4ba2_8182_15ea811ab6fb.slice/crio-6ea22ed6d9ba78487f3790a7bc6d48348cd429f973cfe9024fb66f2ae9d0c306 WatchSource:0}: Error finding container 6ea22ed6d9ba78487f3790a7bc6d48348cd429f973cfe9024fb66f2ae9d0c306: Status 404 returned error can't find the container with id 6ea22ed6d9ba78487f3790a7bc6d48348cd429f973cfe9024fb66f2ae9d0c306
Sep 11 18:00:00.592745 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:00.592717    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-67477b-29819160-px78n"]
Sep 11 18:00:00.593877 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:00:00.593849    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4c89cd9_874d_434f_9042_a41459f0de1b.slice/crio-1aea9d3baea33c46a43202224ae8d0458a64dddcbf8e787c61c38c462a482e01 WatchSource:0}: Error finding container 1aea9d3baea33c46a43202224ae8d0458a64dddcbf8e787c61c38c462a482e01: Status 404 returned error can't find the container with id 1aea9d3baea33c46a43202224ae8d0458a64dddcbf8e787c61c38c462a482e01
Sep 11 18:00:01.015099 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.015068    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-67477b-29819160-px78n" event={"ID":"e4c89cd9-874d-434f-9042-a41459f0de1b","Type":"ContainerStarted","Data":"114e757e69776250b5e38b3060b09e113902b880da0340ddb22d0b949ead431a"}
Sep 11 18:00:01.015281 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.015128    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-67477b-29819160-px78n" event={"ID":"e4c89cd9-874d-434f-9042-a41459f0de1b","Type":"ContainerStarted","Data":"1aea9d3baea33c46a43202224ae8d0458a64dddcbf8e787c61c38c462a482e01"}
Sep 11 18:00:01.016649 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.016627    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-5883b7-29819160-7679b" event={"ID":"221438e5-9c77-4ba2-8182-15ea811ab6fb","Type":"ContainerStarted","Data":"9ebb0f5f06735c41e98aeb8ab04a0a9b0de7024e03049e96640e97867505c337"}
Sep 11 18:00:01.016775 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.016665    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-5883b7-29819160-7679b" event={"ID":"221438e5-9c77-4ba2-8182-15ea811ab6fb","Type":"ContainerStarted","Data":"6ea22ed6d9ba78487f3790a7bc6d48348cd429f973cfe9024fb66f2ae9d0c306"}
Sep 11 18:00:01.055666 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.055561    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-5883b7-29819160-7679b" podStartSLOduration=1.055544424 podStartE2EDuration="1.055544424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:00:01.054957854 +0000 UTC m=+893.980909602" watchObservedRunningTime="2026-09-11 18:00:01.055544424 +0000 UTC m=+893.981496153"
Sep 11 18:00:01.055666 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.055640    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-67477b-29819160-px78n" podStartSLOduration=1.055635417 podStartE2EDuration="1.055635417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:00:01.038211164 +0000 UTC m=+893.964162937" watchObservedRunningTime="2026-09-11 18:00:01.055635417 +0000 UTC m=+893.981587164"
Sep 11 18:00:01.475123 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.475096    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 18:00:01.590437 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.590344    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-credential-socket\") pod \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") "
Sep 11 18:00:01.590437 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.590395    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-token\") pod \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") "
Sep 11 18:00:01.590662 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.590496    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-podinfo\") pod \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") "
Sep 11 18:00:01.590662 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.590526    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-envoy\") pod \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") "
Sep 11 18:00:01.590662 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.590626    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5phh\" (UniqueName: \"kubernetes.io/projected/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-kube-api-access-c5phh\") pod \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") "
Sep 11 18:00:01.590662 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.590654    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istiod-ca-cert\") pod \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") "
Sep 11 18:00:01.590918 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.590685    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-data\") pod \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") "
Sep 11 18:00:01.590918 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.590708    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-workload-socket\") pod \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") "
Sep 11 18:00:01.591035 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.590649    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" (UID: "98d89eb0-36c4-4bf7-993f-5ec71e2acfe7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:00:01.591365 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.591136    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-data" (OuterVolumeSpecName: "istio-data") pod "98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" (UID: "98d89eb0-36c4-4bf7-993f-5ec71e2acfe7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:00:01.591365 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.591181    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-workload-certs\") pod \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\" (UID: \"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7\") "
Sep 11 18:00:01.591516 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.591489    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" (UID: "98d89eb0-36c4-4bf7-993f-5ec71e2acfe7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:00:01.591662 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.591643    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istiod-ca-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:01.591732 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.591669    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-data\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:01.591732 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.591684    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-credential-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:01.591981 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.591947    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" (UID: "98d89eb0-36c4-4bf7-993f-5ec71e2acfe7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:00:01.592065 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.592012    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" (UID: "98d89eb0-36c4-4bf7-993f-5ec71e2acfe7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:00:01.593675 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.593650    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" (UID: "98d89eb0-36c4-4bf7-993f-5ec71e2acfe7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:00:01.593985 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.593962    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-kube-api-access-c5phh" (OuterVolumeSpecName: "kube-api-access-c5phh") pod "98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" (UID: "98d89eb0-36c4-4bf7-993f-5ec71e2acfe7"). InnerVolumeSpecName "kube-api-access-c5phh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:00:01.594093 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.594072    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" (UID: "98d89eb0-36c4-4bf7-993f-5ec71e2acfe7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:00:01.594202 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.594184    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-token" (OuterVolumeSpecName: "istio-token") pod "98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" (UID: "98d89eb0-36c4-4bf7-993f-5ec71e2acfe7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:00:01.693147 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.693110    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-token\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:01.693147 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.693142    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-podinfo\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:01.693147 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.693151    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-istio-envoy\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:01.693403 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.693160    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5phh\" (UniqueName: \"kubernetes.io/projected/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-kube-api-access-c5phh\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:01.693403 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.693170    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-workload-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:01.693403 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:01.693184    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7-workload-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:02.026398 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:02.026362    2579 generic.go:356] "Generic (PLEG): container finished" podID="e4c89cd9-874d-434f-9042-a41459f0de1b" containerID="114e757e69776250b5e38b3060b09e113902b880da0340ddb22d0b949ead431a" exitCode=0
Sep 11 18:00:02.026578 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:02.026452    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-67477b-29819160-px78n" event={"ID":"e4c89cd9-874d-434f-9042-a41459f0de1b","Type":"ContainerDied","Data":"114e757e69776250b5e38b3060b09e113902b880da0340ddb22d0b949ead431a"}
Sep 11 18:00:02.028419 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:02.028392    2579 generic.go:356] "Generic (PLEG): container finished" podID="221438e5-9c77-4ba2-8182-15ea811ab6fb" containerID="9ebb0f5f06735c41e98aeb8ab04a0a9b0de7024e03049e96640e97867505c337" exitCode=0
Sep 11 18:00:02.028554 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:02.028438    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-5883b7-29819160-7679b" event={"ID":"221438e5-9c77-4ba2-8182-15ea811ab6fb","Type":"ContainerDied","Data":"9ebb0f5f06735c41e98aeb8ab04a0a9b0de7024e03049e96640e97867505c337"}
Sep 11 18:00:02.030638 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:02.030611    2579 generic.go:356] "Generic (PLEG): container finished" podID="98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" containerID="3594843f37ed8d7371a98d6a7cbf1150553275a70256886e5a7320c7910759f6" exitCode=0
Sep 11 18:00:02.030793 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:02.030666    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"
Sep 11 18:00:02.030793 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:02.030701    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm" event={"ID":"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7","Type":"ContainerDied","Data":"3594843f37ed8d7371a98d6a7cbf1150553275a70256886e5a7320c7910759f6"}
Sep 11 18:00:02.030793 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:02.030744    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm" event={"ID":"98d89eb0-36c4-4bf7-993f-5ec71e2acfe7","Type":"ContainerDied","Data":"a1390f33fb8523dc72d7377b5312523a2faa8a3c9cbc418014bbdacf45e1122f"}
Sep 11 18:00:02.031002 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:02.030812    2579 scope.go:117] "RemoveContainer" containerID="3594843f37ed8d7371a98d6a7cbf1150553275a70256886e5a7320c7910759f6"
Sep 11 18:00:02.042981 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:02.042931    2579 scope.go:117] "RemoveContainer" containerID="9cf8527bf6a655619bcc4ea8c55826fe4ccaa8fc4dad88a350b8a1abaf01e2e4"
Sep 11 18:00:02.053921 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:02.053870    2579 scope.go:117] "RemoveContainer" containerID="3594843f37ed8d7371a98d6a7cbf1150553275a70256886e5a7320c7910759f6"
Sep 11 18:00:02.054205 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:00:02.054185    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3594843f37ed8d7371a98d6a7cbf1150553275a70256886e5a7320c7910759f6\": container with ID starting with 3594843f37ed8d7371a98d6a7cbf1150553275a70256886e5a7320c7910759f6 not found: ID does not exist" containerID="3594843f37ed8d7371a98d6a7cbf1150553275a70256886e5a7320c7910759f6"
Sep 11 18:00:02.054261 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:02.054215    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3594843f37ed8d7371a98d6a7cbf1150553275a70256886e5a7320c7910759f6"} err="failed to get container status \"3594843f37ed8d7371a98d6a7cbf1150553275a70256886e5a7320c7910759f6\": rpc error: code = NotFound desc = could not find container \"3594843f37ed8d7371a98d6a7cbf1150553275a70256886e5a7320c7910759f6\": container with ID starting with 3594843f37ed8d7371a98d6a7cbf1150553275a70256886e5a7320c7910759f6 not found: ID does not exist"
Sep 11 18:00:02.054323 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:02.054278    2579 scope.go:117] "RemoveContainer" containerID="9cf8527bf6a655619bcc4ea8c55826fe4ccaa8fc4dad88a350b8a1abaf01e2e4"
Sep 11 18:00:02.054602 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:00:02.054579    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cf8527bf6a655619bcc4ea8c55826fe4ccaa8fc4dad88a350b8a1abaf01e2e4\": container with ID starting with 9cf8527bf6a655619bcc4ea8c55826fe4ccaa8fc4dad88a350b8a1abaf01e2e4 not found: ID does not exist" containerID="9cf8527bf6a655619bcc4ea8c55826fe4ccaa8fc4dad88a350b8a1abaf01e2e4"
Sep 11 18:00:02.054687 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:02.054605    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cf8527bf6a655619bcc4ea8c55826fe4ccaa8fc4dad88a350b8a1abaf01e2e4"} err="failed to get container status \"9cf8527bf6a655619bcc4ea8c55826fe4ccaa8fc4dad88a350b8a1abaf01e2e4\": rpc error: code = NotFound desc = could not find container \"9cf8527bf6a655619bcc4ea8c55826fe4ccaa8fc4dad88a350b8a1abaf01e2e4\": container with ID starting with 9cf8527bf6a655619bcc4ea8c55826fe4ccaa8fc4dad88a350b8a1abaf01e2e4 not found: ID does not exist"
Sep 11 18:00:02.137151 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:02.137112    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"]
Sep 11 18:00:02.145690 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:02.145654    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm"]
Sep 11 18:00:03.205128 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:03.205099    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-67477b-29819160-px78n"
Sep 11 18:00:03.207180 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:03.207161    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-5883b7-29819160-7679b"
Sep 11 18:00:03.534586 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:03.534552    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" path="/var/lib/kubelet/pods/98d89eb0-36c4-4bf7-993f-5ec71e2acfe7/volumes"
Sep 11 18:00:04.047054 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:04.047016    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-67477b-29819160-px78n"
Sep 11 18:00:04.047243 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:04.047010    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-67477b-29819160-px78n" event={"ID":"e4c89cd9-874d-434f-9042-a41459f0de1b","Type":"ContainerDied","Data":"1aea9d3baea33c46a43202224ae8d0458a64dddcbf8e787c61c38c462a482e01"}
Sep 11 18:00:04.047243 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:04.047157    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1aea9d3baea33c46a43202224ae8d0458a64dddcbf8e787c61c38c462a482e01"
Sep 11 18:00:04.048551 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:04.048534    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-5883b7-29819160-7679b"
Sep 11 18:00:04.048680 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:04.048535    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-5883b7-29819160-7679b" event={"ID":"221438e5-9c77-4ba2-8182-15ea811ab6fb","Type":"ContainerDied","Data":"6ea22ed6d9ba78487f3790a7bc6d48348cd429f973cfe9024fb66f2ae9d0c306"}
Sep 11 18:00:04.048680 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:04.048643    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ea22ed6d9ba78487f3790a7bc6d48348cd429f973cfe9024fb66f2ae9d0c306"
Sep 11 18:00:05.109807 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.109771    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql"]
Sep 11 18:00:05.110466 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.110436    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c89cd9-874d-434f-9042-a41459f0de1b" containerName="cleanup"
Sep 11 18:00:05.110466 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.110461    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c89cd9-874d-434f-9042-a41459f0de1b" containerName="cleanup"
Sep 11 18:00:05.110617 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.110482    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" containerName="istio-proxy"
Sep 11 18:00:05.110617 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.110491    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" containerName="istio-proxy"
Sep 11 18:00:05.110617 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.110506    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" containerName="istio-proxy"
Sep 11 18:00:05.110617 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.110516    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" containerName="istio-proxy"
Sep 11 18:00:05.110617 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.110532    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="221438e5-9c77-4ba2-8182-15ea811ab6fb" containerName="cleanup"
Sep 11 18:00:05.110617 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.110540    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="221438e5-9c77-4ba2-8182-15ea811ab6fb" containerName="cleanup"
Sep 11 18:00:05.110916 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.110656    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" containerName="istio-proxy"
Sep 11 18:00:05.110916 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.110668    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="98d89eb0-36c4-4bf7-993f-5ec71e2acfe7" containerName="istio-proxy"
Sep 11 18:00:05.110916 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.110680    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="221438e5-9c77-4ba2-8182-15ea811ab6fb" containerName="cleanup"
Sep 11 18:00:05.110916 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.110693    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4c89cd9-874d-434f-9042-a41459f0de1b" containerName="cleanup"
Sep 11 18:00:05.114220 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.114197    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql"
Sep 11 18:00:05.120369 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.118713    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-c83b88f4-dockercfg-2528x\""
Sep 11 18:00:05.120369 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.119051    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-c83b88f4\""
Sep 11 18:00:05.145276 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.145246    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql"]
Sep 11 18:00:05.229085 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.229052    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/138a4d26-7df4-4977-abe5-10789ec2f68d-plugins-config-volume\") pod \"payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql\" (UID: \"138a4d26-7df4-4977-abe5-10789ec2f68d\") " pod="openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql"
Sep 11 18:00:05.229235 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.229159    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs62g\" (UniqueName: \"kubernetes.io/projected/138a4d26-7df4-4977-abe5-10789ec2f68d-kube-api-access-fs62g\") pod \"payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql\" (UID: \"138a4d26-7df4-4977-abe5-10789ec2f68d\") " pod="openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql"
Sep 11 18:00:05.330574 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.330527    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/138a4d26-7df4-4977-abe5-10789ec2f68d-plugins-config-volume\") pod \"payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql\" (UID: \"138a4d26-7df4-4977-abe5-10789ec2f68d\") " pod="openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql"
Sep 11 18:00:05.330730 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.330623    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs62g\" (UniqueName: \"kubernetes.io/projected/138a4d26-7df4-4977-abe5-10789ec2f68d-kube-api-access-fs62g\") pod \"payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql\" (UID: \"138a4d26-7df4-4977-abe5-10789ec2f68d\") " pod="openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql"
Sep 11 18:00:05.331285 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.331265    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/138a4d26-7df4-4977-abe5-10789ec2f68d-plugins-config-volume\") pod \"payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql\" (UID: \"138a4d26-7df4-4977-abe5-10789ec2f68d\") " pod="openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql"
Sep 11 18:00:05.341827 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.341802    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs62g\" (UniqueName: \"kubernetes.io/projected/138a4d26-7df4-4977-abe5-10789ec2f68d-kube-api-access-fs62g\") pod \"payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql\" (UID: \"138a4d26-7df4-4977-abe5-10789ec2f68d\") " pod="openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql"
Sep 11 18:00:05.433198 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.433113    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql"
Sep 11 18:00:05.707560 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:05.707534    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql"]
Sep 11 18:00:05.709098 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:00:05.709075    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod138a4d26_7df4_4977_abe5_10789ec2f68d.slice/crio-ea544c7c643ae64e82676db16fa9eaff6cc742d1538400e4bac659672a5ae60b WatchSource:0}: Error finding container ea544c7c643ae64e82676db16fa9eaff6cc742d1538400e4bac659672a5ae60b: Status 404 returned error can't find the container with id ea544c7c643ae64e82676db16fa9eaff6cc742d1538400e4bac659672a5ae60b
Sep 11 18:00:06.063837 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:06.063797    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql" event={"ID":"138a4d26-7df4-4977-abe5-10789ec2f68d","Type":"ContainerStarted","Data":"ceeab618a185b12ab22e17ab5a957914428b141fc141cfdade207580134ff57f"}
Sep 11 18:00:06.064040 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:06.063865    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql"
Sep 11 18:00:06.064040 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:06.063883    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql" event={"ID":"138a4d26-7df4-4977-abe5-10789ec2f68d","Type":"ContainerStarted","Data":"ea544c7c643ae64e82676db16fa9eaff6cc742d1538400e4bac659672a5ae60b"}
Sep 11 18:00:06.089313 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:06.089251    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql" podStartSLOduration=1.089230462 podStartE2EDuration="1.089230462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:00:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:00:06.087276199 +0000 UTC m=+899.013227947" watchObservedRunningTime="2026-09-11 18:00:06.089230462 +0000 UTC m=+899.015182209"
Sep 11 18:00:07.508707 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:07.508674    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-bbhjk_46c0eccf-9fc2-4fbf-ae39-3b1cf093b352/console-operator/1.log"
Sep 11 18:00:07.509106 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:07.508965    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-bbhjk_46c0eccf-9fc2-4fbf-ae39-3b1cf093b352/console-operator/1.log"
Sep 11 18:00:07.512502 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:07.512481    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zx6_cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd/ovn-acl-logging/0.log"
Sep 11 18:00:07.512691 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:07.512677    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zx6_cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd/ovn-acl-logging/0.log"
Sep 11 18:00:09.444071 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:09.444036    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5883b7-pxt8b"]
Sep 11 18:00:09.448981 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:09.448961    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5883b7-pxt8b"
Sep 11 18:00:09.451890 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:09.451864    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 18:00:09.451890 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:09.451867    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 18:00:09.459229 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:09.459202    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5883b7-pxt8b"]
Sep 11 18:00:09.576259 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:09.576218    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-5883b7-pxt8b\" (UID: \"a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5883b7-pxt8b"
Sep 11 18:00:09.677651 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:09.677586    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-5883b7-pxt8b\" (UID: \"a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5883b7-pxt8b"
Sep 11 18:00:09.678471 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:09.678435    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-5883b7-pxt8b\" (UID: \"a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5883b7-pxt8b"
Sep 11 18:00:09.760097 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:09.760068    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5883b7-pxt8b"
Sep 11 18:00:10.043494 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:10.043470    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5883b7-pxt8b"]
Sep 11 18:00:10.045232 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:00:10.045205    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1fe8d9b_83d7_42c2_a79f_16e14e57d4fe.slice/crio-5122cc416bd74b2d4a08f1112f1466d16f8ce690c065456b98217eb1c5f8b312 WatchSource:0}: Error finding container 5122cc416bd74b2d4a08f1112f1466d16f8ce690c065456b98217eb1c5f8b312: Status 404 returned error can't find the container with id 5122cc416bd74b2d4a08f1112f1466d16f8ce690c065456b98217eb1c5f8b312
Sep 11 18:00:10.088911 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:10.088877    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5883b7-pxt8b" event={"ID":"a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe","Type":"ContainerStarted","Data":"5122cc416bd74b2d4a08f1112f1466d16f8ce690c065456b98217eb1c5f8b312"}
Sep 11 18:00:11.096386 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:11.096343    2579 generic.go:356] "Generic (PLEG): container finished" podID="a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe" containerID="1f8dfc171d01fb32494b337055354e410ef998daf047e40bac0cd6319eb9f5b0" exitCode=0
Sep 11 18:00:11.096910 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:11.096428    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5883b7-pxt8b" event={"ID":"a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe","Type":"ContainerDied","Data":"1f8dfc171d01fb32494b337055354e410ef998daf047e40bac0cd6319eb9f5b0"}
Sep 11 18:00:12.267349 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:12.267326    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5883b7-pxt8b"
Sep 11 18:00:12.417173 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:12.417084    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe-maas-api-service-ca\") pod \"a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe\" (UID: \"a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe\") "
Sep 11 18:00:12.417446 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:12.417423    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe" (UID: "a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:00:12.518943 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:12.518902    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe-maas-api-service-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:13.115577 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:13.115543    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5883b7-pxt8b"
Sep 11 18:00:13.115804 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:13.115573    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5883b7-pxt8b" event={"ID":"a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe","Type":"ContainerDied","Data":"5122cc416bd74b2d4a08f1112f1466d16f8ce690c065456b98217eb1c5f8b312"}
Sep 11 18:00:13.115804 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:13.115637    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5122cc416bd74b2d4a08f1112f1466d16f8ce690c065456b98217eb1c5f8b312"
Sep 11 18:00:17.073521 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:17.073490    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql"
Sep 11 18:00:20.049679 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:20.049645    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-5883b7-29819160-7679b"]
Sep 11 18:00:20.056334 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:20.056311    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-5883b7-29819160-7679b"]
Sep 11 18:00:20.408698 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:20.408618    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5883b7-pxt8b"]
Sep 11 18:00:20.413638 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:20.413613    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5883b7-pxt8b"]
Sep 11 18:00:21.164919 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:21.164884    2579 generic.go:356] "Generic (PLEG): container finished" podID="135a0b1d-dbfb-4976-be56-0193cef1904e" containerID="407bd572479c76bc0251ac476368d31addbb2c1377421bc1f0dbc5ebe3a32d74" exitCode=0
Sep 11 18:00:21.165326 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:21.164958    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw" event={"ID":"135a0b1d-dbfb-4976-be56-0193cef1904e","Type":"ContainerDied","Data":"407bd572479c76bc0251ac476368d31addbb2c1377421bc1f0dbc5ebe3a32d74"}
Sep 11 18:00:21.165406 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:21.165391    2579 scope.go:117] "RemoveContainer" containerID="407bd572479c76bc0251ac476368d31addbb2c1377421bc1f0dbc5ebe3a32d74"
Sep 11 18:00:21.166527 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:21.166503    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:00:21.166582 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:21.166569    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:00:21.166626 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:21.166615    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:00:21.536824 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:21.536788    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="221438e5-9c77-4ba2-8182-15ea811ab6fb" path="/var/lib/kubelet/pods/221438e5-9c77-4ba2-8182-15ea811ab6fb/volumes"
Sep 11 18:00:21.537301 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:21.537280    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe" path="/var/lib/kubelet/pods/a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe/volumes"
Sep 11 18:00:22.172496 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:22.172457    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw" event={"ID":"135a0b1d-dbfb-4976-be56-0193cef1904e","Type":"ContainerStarted","Data":"2483f1489a0122fefbae01e7d9dac8e2b7bf82d6d8450036ddfc36c20cf3c6ab"}
Sep 11 18:00:22.465195 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:22.465106    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 18:00:22.465367 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:22.465297    2579 patch_prober.go:28] interesting pod/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 18:00:22.465420 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:22.465364    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw" podUID="135a0b1d-dbfb-4976-be56-0193cef1904e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 18:00:23.465676 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:23.465639    2579 patch_prober.go:28] interesting pod/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 18:00:23.466139 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:23.465699    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw" podUID="135a0b1d-dbfb-4976-be56-0193cef1904e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 18:00:24.310933 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:24.310892    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c83b88f4-45t8m"]
Sep 11 18:00:24.311599 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:24.311572    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe" containerName="revoke-keys"
Sep 11 18:00:24.311599 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:24.311601    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe" containerName="revoke-keys"
Sep 11 18:00:24.311790 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:24.311753    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1fe8d9b-83d7-42c2-a79f-16e14e57d4fe" containerName="revoke-keys"
Sep 11 18:00:24.314848 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:24.314826    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c83b88f4-45t8m"
Sep 11 18:00:24.320471 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:24.320451    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 18:00:24.320639 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:24.320622    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 18:00:24.332005 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:24.331980    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c83b88f4-45t8m"]
Sep 11 18:00:24.348971 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:24.348935    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72e0f619-7447-49fe-b57e-b0678e1fd210-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c83b88f4-45t8m\" (UID: \"72e0f619-7447-49fe-b57e-b0678e1fd210\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c83b88f4-45t8m"
Sep 11 18:00:24.450405 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:24.450368    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72e0f619-7447-49fe-b57e-b0678e1fd210-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c83b88f4-45t8m\" (UID: \"72e0f619-7447-49fe-b57e-b0678e1fd210\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c83b88f4-45t8m"
Sep 11 18:00:24.451050 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:24.451031    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72e0f619-7447-49fe-b57e-b0678e1fd210-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c83b88f4-45t8m\" (UID: \"72e0f619-7447-49fe-b57e-b0678e1fd210\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c83b88f4-45t8m"
Sep 11 18:00:24.464820 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:24.464799    2579 patch_prober.go:28] interesting pod/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 18:00:24.464882 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:24.464846    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw" podUID="135a0b1d-dbfb-4976-be56-0193cef1904e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 18:00:24.625718 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:24.625623    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c83b88f4-45t8m"
Sep 11 18:00:24.951739 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:24.951712    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c83b88f4-45t8m"]
Sep 11 18:00:25.195770 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:25.195719    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c83b88f4-45t8m" event={"ID":"72e0f619-7447-49fe-b57e-b0678e1fd210","Type":"ContainerStarted","Data":"3ab4f194f0b512ce0a50df81f881bbde6e9dce384e46388d0edebc2b0c2b8c19"}
Sep 11 18:00:25.465118 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:25.465029    2579 patch_prober.go:28] interesting pod/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 18:00:25.465118 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:25.465071    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw" podUID="135a0b1d-dbfb-4976-be56-0193cef1904e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 18:00:26.224017 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:26.223986    2579 generic.go:356] "Generic (PLEG): container finished" podID="72e0f619-7447-49fe-b57e-b0678e1fd210" containerID="395bd5708b416f2ee856a802a49f2396ea297a4134b2e0b012076f0cc76e5e50" exitCode=0
Sep 11 18:00:26.224384 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:26.224064    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c83b88f4-45t8m" event={"ID":"72e0f619-7447-49fe-b57e-b0678e1fd210","Type":"ContainerDied","Data":"395bd5708b416f2ee856a802a49f2396ea297a4134b2e0b012076f0cc76e5e50"}
Sep 11 18:00:26.464664 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:26.464583    2579 patch_prober.go:28] interesting pod/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 18:00:26.464664 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:26.464642    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw" podUID="135a0b1d-dbfb-4976-be56-0193cef1904e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 18:00:27.382536 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:27.382506    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c83b88f4-45t8m"
Sep 11 18:00:27.468281 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:27.468254    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 18:00:27.468727 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:27.468712    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 18:00:27.469334 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:27.469315    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 18:00:27.484291 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:27.484215    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72e0f619-7447-49fe-b57e-b0678e1fd210-maas-api-service-ca\") pod \"72e0f619-7447-49fe-b57e-b0678e1fd210\" (UID: \"72e0f619-7447-49fe-b57e-b0678e1fd210\") "
Sep 11 18:00:27.484561 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:27.484539    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72e0f619-7447-49fe-b57e-b0678e1fd210-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "72e0f619-7447-49fe-b57e-b0678e1fd210" (UID: "72e0f619-7447-49fe-b57e-b0678e1fd210"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:00:27.585884 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:27.585850    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72e0f619-7447-49fe-b57e-b0678e1fd210-maas-api-service-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:28.239340 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:28.239312    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c83b88f4-45t8m"
Sep 11 18:00:28.239505 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:28.239353    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c83b88f4-45t8m" event={"ID":"72e0f619-7447-49fe-b57e-b0678e1fd210","Type":"ContainerDied","Data":"3ab4f194f0b512ce0a50df81f881bbde6e9dce384e46388d0edebc2b0c2b8c19"}
Sep 11 18:00:28.239505 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:28.239399    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ab4f194f0b512ce0a50df81f881bbde6e9dce384e46388d0edebc2b0c2b8c19"
Sep 11 18:00:31.310916 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:31.310879    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql"]
Sep 11 18:00:31.311378 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:31.311137    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql" podUID="138a4d26-7df4-4977-abe5-10789ec2f68d" containerName="payload-processing" containerID="cri-o://ceeab618a185b12ab22e17ab5a957914428b141fc141cfdade207580134ff57f" gracePeriod=30
Sep 11 18:00:31.507246 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:31.507213    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c83b88f4-45t8m"]
Sep 11 18:00:31.510924 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:31.510896    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c83b88f4-45t8m"]
Sep 11 18:00:31.536287 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:31.536250    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72e0f619-7447-49fe-b57e-b0678e1fd210" path="/var/lib/kubelet/pods/72e0f619-7447-49fe-b57e-b0678e1fd210/volumes"
Sep 11 18:00:31.569452 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:31.569390    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql"
Sep 11 18:00:31.627563 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:31.627536    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/138a4d26-7df4-4977-abe5-10789ec2f68d-plugins-config-volume\") pod \"138a4d26-7df4-4977-abe5-10789ec2f68d\" (UID: \"138a4d26-7df4-4977-abe5-10789ec2f68d\") "
Sep 11 18:00:31.627743 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:31.627585    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs62g\" (UniqueName: \"kubernetes.io/projected/138a4d26-7df4-4977-abe5-10789ec2f68d-kube-api-access-fs62g\") pod \"138a4d26-7df4-4977-abe5-10789ec2f68d\" (UID: \"138a4d26-7df4-4977-abe5-10789ec2f68d\") "
Sep 11 18:00:31.627909 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:31.627886    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/138a4d26-7df4-4977-abe5-10789ec2f68d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "138a4d26-7df4-4977-abe5-10789ec2f68d" (UID: "138a4d26-7df4-4977-abe5-10789ec2f68d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:00:31.629635 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:31.629613    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/138a4d26-7df4-4977-abe5-10789ec2f68d-kube-api-access-fs62g" (OuterVolumeSpecName: "kube-api-access-fs62g") pod "138a4d26-7df4-4977-abe5-10789ec2f68d" (UID: "138a4d26-7df4-4977-abe5-10789ec2f68d"). InnerVolumeSpecName "kube-api-access-fs62g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:00:31.668865 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:31.668835    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"]
Sep 11 18:00:31.669045 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:31.669022    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw" podUID="135a0b1d-dbfb-4976-be56-0193cef1904e" containerName="istio-proxy" containerID="cri-o://2483f1489a0122fefbae01e7d9dac8e2b7bf82d6d8450036ddfc36c20cf3c6ab" gracePeriod=30
Sep 11 18:00:31.728639 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:31.728609    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/138a4d26-7df4-4977-abe5-10789ec2f68d-plugins-config-volume\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:31.728639 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:31.728637    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs62g\" (UniqueName: \"kubernetes.io/projected/138a4d26-7df4-4977-abe5-10789ec2f68d-kube-api-access-fs62g\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:32.264700 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:32.264662    2579 generic.go:356] "Generic (PLEG): container finished" podID="138a4d26-7df4-4977-abe5-10789ec2f68d" containerID="ceeab618a185b12ab22e17ab5a957914428b141fc141cfdade207580134ff57f" exitCode=0
Sep 11 18:00:32.264903 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:32.264716    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql"
Sep 11 18:00:32.264903 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:32.264781    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql" event={"ID":"138a4d26-7df4-4977-abe5-10789ec2f68d","Type":"ContainerDied","Data":"ceeab618a185b12ab22e17ab5a957914428b141fc141cfdade207580134ff57f"}
Sep 11 18:00:32.264903 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:32.264844    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql" event={"ID":"138a4d26-7df4-4977-abe5-10789ec2f68d","Type":"ContainerDied","Data":"ea544c7c643ae64e82676db16fa9eaff6cc742d1538400e4bac659672a5ae60b"}
Sep 11 18:00:32.264903 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:32.264871    2579 scope.go:117] "RemoveContainer" containerID="ceeab618a185b12ab22e17ab5a957914428b141fc141cfdade207580134ff57f"
Sep 11 18:00:32.274331 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:32.274312    2579 scope.go:117] "RemoveContainer" containerID="ceeab618a185b12ab22e17ab5a957914428b141fc141cfdade207580134ff57f"
Sep 11 18:00:32.274579 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:00:32.274561    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ceeab618a185b12ab22e17ab5a957914428b141fc141cfdade207580134ff57f\": container with ID starting with ceeab618a185b12ab22e17ab5a957914428b141fc141cfdade207580134ff57f not found: ID does not exist" containerID="ceeab618a185b12ab22e17ab5a957914428b141fc141cfdade207580134ff57f"
Sep 11 18:00:32.274645 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:32.274586    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceeab618a185b12ab22e17ab5a957914428b141fc141cfdade207580134ff57f"} err="failed to get container status \"ceeab618a185b12ab22e17ab5a957914428b141fc141cfdade207580134ff57f\": rpc error: code = NotFound desc = could not find container \"ceeab618a185b12ab22e17ab5a957914428b141fc141cfdade207580134ff57f\": container with ID starting with ceeab618a185b12ab22e17ab5a957914428b141fc141cfdade207580134ff57f not found: ID does not exist"
Sep 11 18:00:32.290771 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:32.290726    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql"]
Sep 11 18:00:32.299885 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:32.299861    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql"]
Sep 11 18:00:33.535340 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:33.535310    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="138a4d26-7df4-4977-abe5-10789ec2f68d" path="/var/lib/kubelet/pods/138a4d26-7df4-4977-abe5-10789ec2f68d/volumes"
Sep 11 18:00:36.928741 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:36.928715    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 18:00:36.980330 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:36.980230    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkb5c\" (UniqueName: \"kubernetes.io/projected/135a0b1d-dbfb-4976-be56-0193cef1904e-kube-api-access-qkb5c\") pod \"135a0b1d-dbfb-4976-be56-0193cef1904e\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") "
Sep 11 18:00:36.980330 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:36.980308    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-workload-certs\") pod \"135a0b1d-dbfb-4976-be56-0193cef1904e\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") "
Sep 11 18:00:36.980558 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:36.980344    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-podinfo\") pod \"135a0b1d-dbfb-4976-be56-0193cef1904e\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") "
Sep 11 18:00:36.980558 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:36.980365    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-data\") pod \"135a0b1d-dbfb-4976-be56-0193cef1904e\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") "
Sep 11 18:00:36.980558 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:36.980436    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-envoy\") pod \"135a0b1d-dbfb-4976-be56-0193cef1904e\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") "
Sep 11 18:00:36.980558 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:36.980508    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/135a0b1d-dbfb-4976-be56-0193cef1904e-istiod-ca-cert\") pod \"135a0b1d-dbfb-4976-be56-0193cef1904e\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") "
Sep 11 18:00:36.980558 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:36.980536    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-workload-socket\") pod \"135a0b1d-dbfb-4976-be56-0193cef1904e\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") "
Sep 11 18:00:36.980852 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:36.980579    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-token\") pod \"135a0b1d-dbfb-4976-be56-0193cef1904e\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") "
Sep 11 18:00:36.980852 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:36.980606    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-credential-socket\") pod \"135a0b1d-dbfb-4976-be56-0193cef1904e\" (UID: \"135a0b1d-dbfb-4976-be56-0193cef1904e\") "
Sep 11 18:00:36.981663 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:36.981316    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "135a0b1d-dbfb-4976-be56-0193cef1904e" (UID: "135a0b1d-dbfb-4976-be56-0193cef1904e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:00:36.981663 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:36.981373    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "135a0b1d-dbfb-4976-be56-0193cef1904e" (UID: "135a0b1d-dbfb-4976-be56-0193cef1904e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:00:36.981663 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:36.981563    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "135a0b1d-dbfb-4976-be56-0193cef1904e" (UID: "135a0b1d-dbfb-4976-be56-0193cef1904e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:00:36.982272 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:36.982228    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-data" (OuterVolumeSpecName: "istio-data") pod "135a0b1d-dbfb-4976-be56-0193cef1904e" (UID: "135a0b1d-dbfb-4976-be56-0193cef1904e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:00:36.982537 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:36.982504    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/135a0b1d-dbfb-4976-be56-0193cef1904e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "135a0b1d-dbfb-4976-be56-0193cef1904e" (UID: "135a0b1d-dbfb-4976-be56-0193cef1904e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:00:36.983490 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:36.983452    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "135a0b1d-dbfb-4976-be56-0193cef1904e" (UID: "135a0b1d-dbfb-4976-be56-0193cef1904e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:00:36.984176 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:36.984155    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-token" (OuterVolumeSpecName: "istio-token") pod "135a0b1d-dbfb-4976-be56-0193cef1904e" (UID: "135a0b1d-dbfb-4976-be56-0193cef1904e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:00:36.985141 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:36.985106    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/135a0b1d-dbfb-4976-be56-0193cef1904e-kube-api-access-qkb5c" (OuterVolumeSpecName: "kube-api-access-qkb5c") pod "135a0b1d-dbfb-4976-be56-0193cef1904e" (UID: "135a0b1d-dbfb-4976-be56-0193cef1904e"). InnerVolumeSpecName "kube-api-access-qkb5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:00:36.985292 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:36.985273    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "135a0b1d-dbfb-4976-be56-0193cef1904e" (UID: "135a0b1d-dbfb-4976-be56-0193cef1904e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:00:37.082079 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.082036    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-workload-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:37.082079 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.082074    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-podinfo\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:37.082079 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.082083    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-data\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:37.082314 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.082092    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-envoy\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:37.082314 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.082100    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/135a0b1d-dbfb-4976-be56-0193cef1904e-istiod-ca-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:37.082314 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.082108    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-workload-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:37.082314 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.082116    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/135a0b1d-dbfb-4976-be56-0193cef1904e-istio-token\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:37.082314 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.082124    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/135a0b1d-dbfb-4976-be56-0193cef1904e-credential-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:37.082314 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.082133    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkb5c\" (UniqueName: \"kubernetes.io/projected/135a0b1d-dbfb-4976-be56-0193cef1904e-kube-api-access-qkb5c\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:00:37.297475 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.297438    2579 generic.go:356] "Generic (PLEG): container finished" podID="135a0b1d-dbfb-4976-be56-0193cef1904e" containerID="2483f1489a0122fefbae01e7d9dac8e2b7bf82d6d8450036ddfc36c20cf3c6ab" exitCode=0
Sep 11 18:00:37.297657 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.297493    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"
Sep 11 18:00:37.297657 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.297516    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw" event={"ID":"135a0b1d-dbfb-4976-be56-0193cef1904e","Type":"ContainerDied","Data":"2483f1489a0122fefbae01e7d9dac8e2b7bf82d6d8450036ddfc36c20cf3c6ab"}
Sep 11 18:00:37.297657 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.297567    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw" event={"ID":"135a0b1d-dbfb-4976-be56-0193cef1904e","Type":"ContainerDied","Data":"d7be1bf273800fbbc7510d3a131125e85f1d596f89fb0815ba1438ac331fb750"}
Sep 11 18:00:37.297657 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.297589    2579 scope.go:117] "RemoveContainer" containerID="2483f1489a0122fefbae01e7d9dac8e2b7bf82d6d8450036ddfc36c20cf3c6ab"
Sep 11 18:00:37.307306 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.307288    2579 scope.go:117] "RemoveContainer" containerID="407bd572479c76bc0251ac476368d31addbb2c1377421bc1f0dbc5ebe3a32d74"
Sep 11 18:00:37.315746 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.315727    2579 scope.go:117] "RemoveContainer" containerID="2483f1489a0122fefbae01e7d9dac8e2b7bf82d6d8450036ddfc36c20cf3c6ab"
Sep 11 18:00:37.315987 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:00:37.315972    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2483f1489a0122fefbae01e7d9dac8e2b7bf82d6d8450036ddfc36c20cf3c6ab\": container with ID starting with 2483f1489a0122fefbae01e7d9dac8e2b7bf82d6d8450036ddfc36c20cf3c6ab not found: ID does not exist" containerID="2483f1489a0122fefbae01e7d9dac8e2b7bf82d6d8450036ddfc36c20cf3c6ab"
Sep 11 18:00:37.316039 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.315994    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2483f1489a0122fefbae01e7d9dac8e2b7bf82d6d8450036ddfc36c20cf3c6ab"} err="failed to get container status \"2483f1489a0122fefbae01e7d9dac8e2b7bf82d6d8450036ddfc36c20cf3c6ab\": rpc error: code = NotFound desc = could not find container \"2483f1489a0122fefbae01e7d9dac8e2b7bf82d6d8450036ddfc36c20cf3c6ab\": container with ID starting with 2483f1489a0122fefbae01e7d9dac8e2b7bf82d6d8450036ddfc36c20cf3c6ab not found: ID does not exist"
Sep 11 18:00:37.316039 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.316008    2579 scope.go:117] "RemoveContainer" containerID="407bd572479c76bc0251ac476368d31addbb2c1377421bc1f0dbc5ebe3a32d74"
Sep 11 18:00:37.316279 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:00:37.316259    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"407bd572479c76bc0251ac476368d31addbb2c1377421bc1f0dbc5ebe3a32d74\": container with ID starting with 407bd572479c76bc0251ac476368d31addbb2c1377421bc1f0dbc5ebe3a32d74 not found: ID does not exist" containerID="407bd572479c76bc0251ac476368d31addbb2c1377421bc1f0dbc5ebe3a32d74"
Sep 11 18:00:37.316325 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.316283    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"407bd572479c76bc0251ac476368d31addbb2c1377421bc1f0dbc5ebe3a32d74"} err="failed to get container status \"407bd572479c76bc0251ac476368d31addbb2c1377421bc1f0dbc5ebe3a32d74\": rpc error: code = NotFound desc = could not find container \"407bd572479c76bc0251ac476368d31addbb2c1377421bc1f0dbc5ebe3a32d74\": container with ID starting with 407bd572479c76bc0251ac476368d31addbb2c1377421bc1f0dbc5ebe3a32d74 not found: ID does not exist"
Sep 11 18:00:37.321204 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.321182    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"]
Sep 11 18:00:37.326196 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.326174    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw"]
Sep 11 18:00:37.535514 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:00:37.535481    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="135a0b1d-dbfb-4976-be56-0193cef1904e" path="/var/lib/kubelet/pods/135a0b1d-dbfb-4976-be56-0193cef1904e/volumes"
Sep 11 18:01:03.911448 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:03.911408    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"]
Sep 11 18:01:03.911981 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:03.911623    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz" podUID="6a89401a-cd21-48ae-af46-15729267940f" containerName="istio-proxy" containerID="cri-o://161e8fc2b86fd39e153eb1220d45170f39100817d9b93bde884655f11c163fed" gracePeriod=30
Sep 11 18:01:04.730323 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.730287    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"]
Sep 11 18:01:04.731027 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.731002    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="135a0b1d-dbfb-4976-be56-0193cef1904e" containerName="istio-proxy"
Sep 11 18:01:04.731027 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.731028    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="135a0b1d-dbfb-4976-be56-0193cef1904e" containerName="istio-proxy"
Sep 11 18:01:04.731198 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.731041    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="135a0b1d-dbfb-4976-be56-0193cef1904e" containerName="istio-proxy"
Sep 11 18:01:04.731198 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.731047    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="135a0b1d-dbfb-4976-be56-0193cef1904e" containerName="istio-proxy"
Sep 11 18:01:04.731198 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.731060    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72e0f619-7447-49fe-b57e-b0678e1fd210" containerName="revoke-keys"
Sep 11 18:01:04.731198 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.731066    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="72e0f619-7447-49fe-b57e-b0678e1fd210" containerName="revoke-keys"
Sep 11 18:01:04.731198 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.731079    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="138a4d26-7df4-4977-abe5-10789ec2f68d" containerName="payload-processing"
Sep 11 18:01:04.731198 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.731084    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="138a4d26-7df4-4977-abe5-10789ec2f68d" containerName="payload-processing"
Sep 11 18:01:04.731198 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.731149    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="72e0f619-7447-49fe-b57e-b0678e1fd210" containerName="revoke-keys"
Sep 11 18:01:04.731198 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.731157    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="135a0b1d-dbfb-4976-be56-0193cef1904e" containerName="istio-proxy"
Sep 11 18:01:04.731198 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.731170    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="138a4d26-7df4-4977-abe5-10789ec2f68d" containerName="payload-processing"
Sep 11 18:01:04.731198 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.731179    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="135a0b1d-dbfb-4976-be56-0193cef1904e" containerName="istio-proxy"
Sep 11 18:01:04.735951 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.735931    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.743440 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.743417    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-c69872-openshift-default-dockercfg-xzdzv\""
Sep 11 18:01:04.751641 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.751616    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"]
Sep 11 18:01:04.860273 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.860240    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-workload-socket\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.860450 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.860296    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc13248b-66ff-4929-a9b4-49a634219b61-istio-podinfo\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.860450 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.860320    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc13248b-66ff-4929-a9b4-49a634219b61-istiod-ca-cert\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.860450 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.860364    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-workload-certs\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.860450 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.860385    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc13248b-66ff-4929-a9b4-49a634219b61-istio-token\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.860450 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.860405    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-istio-data\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.860638 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.860456    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-credential-socket\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.860638 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.860474    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-istio-envoy\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.860638 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.860493    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng8t8\" (UniqueName: \"kubernetes.io/projected/bc13248b-66ff-4929-a9b4-49a634219b61-kube-api-access-ng8t8\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.961061 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.961027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc13248b-66ff-4929-a9b4-49a634219b61-istio-podinfo\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.961562 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.961082    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc13248b-66ff-4929-a9b4-49a634219b61-istiod-ca-cert\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.961562 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.961120    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-workload-certs\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.961562 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.961153    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc13248b-66ff-4929-a9b4-49a634219b61-istio-token\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.961562 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.961187    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-istio-data\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.961562 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.961287    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-credential-socket\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.961562 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.961315    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-istio-envoy\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.961562 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.961354    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng8t8\" (UniqueName: \"kubernetes.io/projected/bc13248b-66ff-4929-a9b4-49a634219b61-kube-api-access-ng8t8\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.961562 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.961390    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-workload-socket\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.962373 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.961566    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-workload-certs\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.962373 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.961613    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-istio-data\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.962373 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.961828    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-credential-socket\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.962373 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.961893    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-workload-socket\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.962373 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.962031    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc13248b-66ff-4929-a9b4-49a634219b61-istiod-ca-cert\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.963510 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.963489    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-istio-envoy\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.963714 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.963698    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc13248b-66ff-4929-a9b4-49a634219b61-istio-podinfo\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.974346 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.974320    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc13248b-66ff-4929-a9b4-49a634219b61-istio-token\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:04.974528 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:04.974510    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng8t8\" (UniqueName: \"kubernetes.io/projected/bc13248b-66ff-4929-a9b4-49a634219b61-kube-api-access-ng8t8\") pod \"e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") " pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:05.047143 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:05.047113    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:05.326687 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:05.326661    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"]
Sep 11 18:01:05.328554 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:01:05.328527    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc13248b_66ff_4929_a9b4_49a634219b61.slice/crio-a6c05f8c73c9c4d054e4f41788a71b721c831b9658ca446fd205aaf36172ff97 WatchSource:0}: Error finding container a6c05f8c73c9c4d054e4f41788a71b721c831b9658ca446fd205aaf36172ff97: Status 404 returned error can't find the container with id a6c05f8c73c9c4d054e4f41788a71b721c831b9658ca446fd205aaf36172ff97
Sep 11 18:01:05.335808 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:05.331292    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:01:05.335808 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:05.331467    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:01:05.335808 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:05.331780    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:01:05.461862 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:05.461823    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6" event={"ID":"bc13248b-66ff-4929-a9b4-49a634219b61","Type":"ContainerStarted","Data":"4f944e6ff8597721d10a3adaa80f85ae403a85b8b12b488499ad2df5953943bf"}
Sep 11 18:01:05.462042 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:05.461926    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6" event={"ID":"bc13248b-66ff-4929-a9b4-49a634219b61","Type":"ContainerStarted","Data":"a6c05f8c73c9c4d054e4f41788a71b721c831b9658ca446fd205aaf36172ff97"}
Sep 11 18:01:05.503740 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:05.503676    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6" podStartSLOduration=1.503652517 podStartE2EDuration="1.503652517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:01:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:01:05.499571219 +0000 UTC m=+958.425522968" watchObservedRunningTime="2026-09-11 18:01:05.503652517 +0000 UTC m=+958.429604264"
Sep 11 18:01:06.047913 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:06.047876    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:06.053198 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:06.053172    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:06.467095 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:06.467003    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:06.467867 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:06.467846    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:06.823783 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:06.823723    2579 patch_prober.go:28] interesting pod/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 18:01:06.823932 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:06.823799    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz" podUID="6a89401a-cd21-48ae-af46-15729267940f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 18:01:09.157062 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.157041    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 18:01:09.205369 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.205285    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-istio-data\") pod \"6a89401a-cd21-48ae-af46-15729267940f\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") "
Sep 11 18:01:09.205369 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.205316    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-istio-envoy\") pod \"6a89401a-cd21-48ae-af46-15729267940f\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") "
Sep 11 18:01:09.205369 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.205354    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a89401a-cd21-48ae-af46-15729267940f-istiod-ca-cert\") pod \"6a89401a-cd21-48ae-af46-15729267940f\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") "
Sep 11 18:01:09.205648 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.205390    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66qkp\" (UniqueName: \"kubernetes.io/projected/6a89401a-cd21-48ae-af46-15729267940f-kube-api-access-66qkp\") pod \"6a89401a-cd21-48ae-af46-15729267940f\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") "
Sep 11 18:01:09.205648 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.205417    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a89401a-cd21-48ae-af46-15729267940f-istio-podinfo\") pod \"6a89401a-cd21-48ae-af46-15729267940f\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") "
Sep 11 18:01:09.205648 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.205597    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-istio-data" (OuterVolumeSpecName: "istio-data") pod "6a89401a-cd21-48ae-af46-15729267940f" (UID: "6a89401a-cd21-48ae-af46-15729267940f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:01:09.205817 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.205667    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a89401a-cd21-48ae-af46-15729267940f-istio-token\") pod \"6a89401a-cd21-48ae-af46-15729267940f\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") "
Sep 11 18:01:09.205817 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.205729    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-workload-socket\") pod \"6a89401a-cd21-48ae-af46-15729267940f\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") "
Sep 11 18:01:09.205935 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.205841    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a89401a-cd21-48ae-af46-15729267940f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6a89401a-cd21-48ae-af46-15729267940f" (UID: "6a89401a-cd21-48ae-af46-15729267940f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:01:09.205935 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.205896    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-workload-certs\") pod \"6a89401a-cd21-48ae-af46-15729267940f\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") "
Sep 11 18:01:09.205935 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.205924    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-credential-socket\") pod \"6a89401a-cd21-48ae-af46-15729267940f\" (UID: \"6a89401a-cd21-48ae-af46-15729267940f\") "
Sep 11 18:01:09.206088 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.206073    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6a89401a-cd21-48ae-af46-15729267940f" (UID: "6a89401a-cd21-48ae-af46-15729267940f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:01:09.206287 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.206267    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6a89401a-cd21-48ae-af46-15729267940f" (UID: "6a89401a-cd21-48ae-af46-15729267940f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:01:09.206327 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.206279    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6a89401a-cd21-48ae-af46-15729267940f" (UID: "6a89401a-cd21-48ae-af46-15729267940f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:01:09.206401 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.206384    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-workload-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:01:09.206448 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.206408    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-credential-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:01:09.206448 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.206422    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-istio-data\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:01:09.206448 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.206435    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a89401a-cd21-48ae-af46-15729267940f-istiod-ca-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:01:09.206448 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.206447    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-workload-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:01:09.207885 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.207858    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a89401a-cd21-48ae-af46-15729267940f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6a89401a-cd21-48ae-af46-15729267940f" (UID: "6a89401a-cd21-48ae-af46-15729267940f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:01:09.208188 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.208168    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a89401a-cd21-48ae-af46-15729267940f-kube-api-access-66qkp" (OuterVolumeSpecName: "kube-api-access-66qkp") pod "6a89401a-cd21-48ae-af46-15729267940f" (UID: "6a89401a-cd21-48ae-af46-15729267940f"). InnerVolumeSpecName "kube-api-access-66qkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:01:09.208288 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.208262    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a89401a-cd21-48ae-af46-15729267940f-istio-token" (OuterVolumeSpecName: "istio-token") pod "6a89401a-cd21-48ae-af46-15729267940f" (UID: "6a89401a-cd21-48ae-af46-15729267940f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:01:09.209274 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.209253    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6a89401a-cd21-48ae-af46-15729267940f" (UID: "6a89401a-cd21-48ae-af46-15729267940f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:01:09.307076 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.307038    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a89401a-cd21-48ae-af46-15729267940f-istio-envoy\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:01:09.307076 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.307069    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66qkp\" (UniqueName: \"kubernetes.io/projected/6a89401a-cd21-48ae-af46-15729267940f-kube-api-access-66qkp\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:01:09.307076 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.307079    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a89401a-cd21-48ae-af46-15729267940f-istio-podinfo\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:01:09.307296 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.307088    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a89401a-cd21-48ae-af46-15729267940f-istio-token\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:01:09.486674 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.486585    2579 generic.go:356] "Generic (PLEG): container finished" podID="6a89401a-cd21-48ae-af46-15729267940f" containerID="161e8fc2b86fd39e153eb1220d45170f39100817d9b93bde884655f11c163fed" exitCode=0
Sep 11 18:01:09.486674 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.486632    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"
Sep 11 18:01:09.486674 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.486648    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz" event={"ID":"6a89401a-cd21-48ae-af46-15729267940f","Type":"ContainerDied","Data":"161e8fc2b86fd39e153eb1220d45170f39100817d9b93bde884655f11c163fed"}
Sep 11 18:01:09.486969 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.486690    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz" event={"ID":"6a89401a-cd21-48ae-af46-15729267940f","Type":"ContainerDied","Data":"b881fdafc578d8a52ea36a05942ed5c9aea87b6218f5441cb53b3738f5882895"}
Sep 11 18:01:09.486969 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.486712    2579 scope.go:117] "RemoveContainer" containerID="161e8fc2b86fd39e153eb1220d45170f39100817d9b93bde884655f11c163fed"
Sep 11 18:01:09.496508 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.496491    2579 scope.go:117] "RemoveContainer" containerID="18c175b9c698d5335eeacc4d3be12f2401883db5e0aa2f7ab3bf4d372630c360"
Sep 11 18:01:09.504625 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.504606    2579 scope.go:117] "RemoveContainer" containerID="161e8fc2b86fd39e153eb1220d45170f39100817d9b93bde884655f11c163fed"
Sep 11 18:01:09.504929 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:01:09.504907    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"161e8fc2b86fd39e153eb1220d45170f39100817d9b93bde884655f11c163fed\": container with ID starting with 161e8fc2b86fd39e153eb1220d45170f39100817d9b93bde884655f11c163fed not found: ID does not exist" containerID="161e8fc2b86fd39e153eb1220d45170f39100817d9b93bde884655f11c163fed"
Sep 11 18:01:09.504992 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.504939    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"161e8fc2b86fd39e153eb1220d45170f39100817d9b93bde884655f11c163fed"} err="failed to get container status \"161e8fc2b86fd39e153eb1220d45170f39100817d9b93bde884655f11c163fed\": rpc error: code = NotFound desc = could not find container \"161e8fc2b86fd39e153eb1220d45170f39100817d9b93bde884655f11c163fed\": container with ID starting with 161e8fc2b86fd39e153eb1220d45170f39100817d9b93bde884655f11c163fed not found: ID does not exist"
Sep 11 18:01:09.504992 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.504955    2579 scope.go:117] "RemoveContainer" containerID="18c175b9c698d5335eeacc4d3be12f2401883db5e0aa2f7ab3bf4d372630c360"
Sep 11 18:01:09.505210 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:01:09.505191    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18c175b9c698d5335eeacc4d3be12f2401883db5e0aa2f7ab3bf4d372630c360\": container with ID starting with 18c175b9c698d5335eeacc4d3be12f2401883db5e0aa2f7ab3bf4d372630c360 not found: ID does not exist" containerID="18c175b9c698d5335eeacc4d3be12f2401883db5e0aa2f7ab3bf4d372630c360"
Sep 11 18:01:09.505265 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.505218    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18c175b9c698d5335eeacc4d3be12f2401883db5e0aa2f7ab3bf4d372630c360"} err="failed to get container status \"18c175b9c698d5335eeacc4d3be12f2401883db5e0aa2f7ab3bf4d372630c360\": rpc error: code = NotFound desc = could not find container \"18c175b9c698d5335eeacc4d3be12f2401883db5e0aa2f7ab3bf4d372630c360\": container with ID starting with 18c175b9c698d5335eeacc4d3be12f2401883db5e0aa2f7ab3bf4d372630c360 not found: ID does not exist"
Sep 11 18:01:09.513151 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.513128    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"]
Sep 11 18:01:09.515105 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.515084    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz"]
Sep 11 18:01:09.534715 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:09.534686    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a89401a-cd21-48ae-af46-15729267940f" path="/var/lib/kubelet/pods/6a89401a-cd21-48ae-af46-15729267940f/volumes"
Sep 11 18:01:10.757123 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:10.757083    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn"]
Sep 11 18:01:10.757570 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:10.757555    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a89401a-cd21-48ae-af46-15729267940f" containerName="istio-proxy"
Sep 11 18:01:10.757623 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:10.757572    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a89401a-cd21-48ae-af46-15729267940f" containerName="istio-proxy"
Sep 11 18:01:10.757623 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:10.757600    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a89401a-cd21-48ae-af46-15729267940f" containerName="istio-proxy"
Sep 11 18:01:10.757623 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:10.757606    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a89401a-cd21-48ae-af46-15729267940f" containerName="istio-proxy"
Sep 11 18:01:10.757733 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:10.757683    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a89401a-cd21-48ae-af46-15729267940f" containerName="istio-proxy"
Sep 11 18:01:10.762083 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:10.762067    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn"
Sep 11 18:01:10.765013 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:10.764993    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-c69872\""
Sep 11 18:01:10.765465 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:10.765449    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-c69872-dockercfg-qh5t7\""
Sep 11 18:01:10.796203 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:10.796172    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn"]
Sep 11 18:01:10.822616 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:10.822577    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee155865-94d9-45f3-8d64-dd99eb5ebfb9-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn\" (UID: \"ee155865-94d9-45f3-8d64-dd99eb5ebfb9\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn"
Sep 11 18:01:10.822805 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:10.822631    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp5hw\" (UniqueName: \"kubernetes.io/projected/ee155865-94d9-45f3-8d64-dd99eb5ebfb9-kube-api-access-lp5hw\") pod \"payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn\" (UID: \"ee155865-94d9-45f3-8d64-dd99eb5ebfb9\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn"
Sep 11 18:01:10.923854 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:10.923820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee155865-94d9-45f3-8d64-dd99eb5ebfb9-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn\" (UID: \"ee155865-94d9-45f3-8d64-dd99eb5ebfb9\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn"
Sep 11 18:01:10.924017 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:10.923867    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp5hw\" (UniqueName: \"kubernetes.io/projected/ee155865-94d9-45f3-8d64-dd99eb5ebfb9-kube-api-access-lp5hw\") pod \"payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn\" (UID: \"ee155865-94d9-45f3-8d64-dd99eb5ebfb9\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn"
Sep 11 18:01:10.924488 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:10.924468    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee155865-94d9-45f3-8d64-dd99eb5ebfb9-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn\" (UID: \"ee155865-94d9-45f3-8d64-dd99eb5ebfb9\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn"
Sep 11 18:01:10.941152 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:10.941125    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp5hw\" (UniqueName: \"kubernetes.io/projected/ee155865-94d9-45f3-8d64-dd99eb5ebfb9-kube-api-access-lp5hw\") pod \"payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn\" (UID: \"ee155865-94d9-45f3-8d64-dd99eb5ebfb9\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn"
Sep 11 18:01:11.073107 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:11.073014    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn"
Sep 11 18:01:11.357681 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:11.357605    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn"]
Sep 11 18:01:11.365205 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:01:11.365176    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee155865_94d9_45f3_8d64_dd99eb5ebfb9.slice/crio-aa964861794a31131933463f63cf37b05c97a5a58e06a52c8081275466b2dc13 WatchSource:0}: Error finding container aa964861794a31131933463f63cf37b05c97a5a58e06a52c8081275466b2dc13: Status 404 returned error can't find the container with id aa964861794a31131933463f63cf37b05c97a5a58e06a52c8081275466b2dc13
Sep 11 18:01:11.503418 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:11.503385    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn" event={"ID":"ee155865-94d9-45f3-8d64-dd99eb5ebfb9","Type":"ContainerStarted","Data":"8c7623ee815cc75ef65b6e2b633a0656df09ccac76b01ca62aeaa74af91b3484"}
Sep 11 18:01:11.503597 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:11.503455    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn" event={"ID":"ee155865-94d9-45f3-8d64-dd99eb5ebfb9","Type":"ContainerStarted","Data":"aa964861794a31131933463f63cf37b05c97a5a58e06a52c8081275466b2dc13"}
Sep 11 18:01:11.503597 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:11.503486    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn"
Sep 11 18:01:11.553011 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:11.552962    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn" podStartSLOduration=1.552945485 podStartE2EDuration="1.552945485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:01:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:01:11.55119728 +0000 UTC m=+964.477149026" watchObservedRunningTime="2026-09-11 18:01:11.552945485 +0000 UTC m=+964.478897230"
Sep 11 18:01:22.512877 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:22.512842    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn"
Sep 11 18:01:27.599728 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:27.599691    2579 generic.go:356] "Generic (PLEG): container finished" podID="bc13248b-66ff-4929-a9b4-49a634219b61" containerID="4f944e6ff8597721d10a3adaa80f85ae403a85b8b12b488499ad2df5953943bf" exitCode=0
Sep 11 18:01:27.600172 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:27.599778    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6" event={"ID":"bc13248b-66ff-4929-a9b4-49a634219b61","Type":"ContainerDied","Data":"4f944e6ff8597721d10a3adaa80f85ae403a85b8b12b488499ad2df5953943bf"}
Sep 11 18:01:27.600172 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:27.600165    2579 scope.go:117] "RemoveContainer" containerID="4f944e6ff8597721d10a3adaa80f85ae403a85b8b12b488499ad2df5953943bf"
Sep 11 18:01:27.601208 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:27.601179    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:01:27.601275 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:27.601249    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:01:27.601328 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:27.601279    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:01:28.615141 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:28.615097    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6" event={"ID":"bc13248b-66ff-4929-a9b4-49a634219b61","Type":"ContainerStarted","Data":"6b56dbf74c66ae3d070cd17946614ec6f900638e2e8dfd8303cef62f77d923ea"}
Sep 11 18:01:29.047740 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:29.047699    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:29.047964 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:29.047942    2579 patch_prober.go:28] interesting pod/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 11 18:01:29.048011 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:29.047990    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6" podUID="bc13248b-66ff-4929-a9b4-49a634219b61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 11 18:01:30.048139 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:30.048097    2579 patch_prober.go:28] interesting pod/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 11 18:01:30.048522 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:30.048195    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6" podUID="bc13248b-66ff-4929-a9b4-49a634219b61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 11 18:01:31.048274 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:31.048233    2579 patch_prober.go:28] interesting pod/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 11 18:01:31.048660 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:31.048293    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6" podUID="bc13248b-66ff-4929-a9b4-49a634219b61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 11 18:01:32.047995 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:32.047960    2579 patch_prober.go:28] interesting pod/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 11 18:01:32.048171 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:32.048015    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6" podUID="bc13248b-66ff-4929-a9b4-49a634219b61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 11 18:01:33.047686 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:33.047653    2579 patch_prober.go:28] interesting pod/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 11 18:01:33.048121 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:33.047707    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6" podUID="bc13248b-66ff-4929-a9b4-49a634219b61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 11 18:01:34.052007 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:34.051978    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:34.052467 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:34.052333    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:01:34.053070 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:01:34.053051    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:02:06.429187 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:06.429152    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c69872-bhftg"]
Sep 11 18:02:06.429703 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:06.429689    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a89401a-cd21-48ae-af46-15729267940f" containerName="istio-proxy"
Sep 11 18:02:06.431831 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:06.431811    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c69872-bhftg"
Sep 11 18:02:06.438415 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:06.438386    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 18:02:06.438975 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:06.438686    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 18:02:06.449289 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:06.449257    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c69872-bhftg"]
Sep 11 18:02:06.603195 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:06.603156    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eac6edcc-4220-4064-ae7f-2a281e81f77d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-c69872-bhftg\" (UID: \"eac6edcc-4220-4064-ae7f-2a281e81f77d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c69872-bhftg"
Sep 11 18:02:06.704131 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:06.704045    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eac6edcc-4220-4064-ae7f-2a281e81f77d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-c69872-bhftg\" (UID: \"eac6edcc-4220-4064-ae7f-2a281e81f77d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c69872-bhftg"
Sep 11 18:02:06.704669 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:06.704650    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eac6edcc-4220-4064-ae7f-2a281e81f77d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-c69872-bhftg\" (UID: \"eac6edcc-4220-4064-ae7f-2a281e81f77d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c69872-bhftg"
Sep 11 18:02:06.741975 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:06.741930    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c69872-bhftg"
Sep 11 18:02:07.025845 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:07.025808    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c69872-bhftg"]
Sep 11 18:02:07.028382 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:02:07.028351    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeac6edcc_4220_4064_ae7f_2a281e81f77d.slice/crio-4ea1890d21965a9a1dabdbe2ca04d287ac72212249dc54ff8437aeff4433d2a7 WatchSource:0}: Error finding container 4ea1890d21965a9a1dabdbe2ca04d287ac72212249dc54ff8437aeff4433d2a7: Status 404 returned error can't find the container with id 4ea1890d21965a9a1dabdbe2ca04d287ac72212249dc54ff8437aeff4433d2a7
Sep 11 18:02:07.840805 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:07.840691    2579 generic.go:356] "Generic (PLEG): container finished" podID="eac6edcc-4220-4064-ae7f-2a281e81f77d" containerID="8bfbf7e41f5f3c9b296e4abda7fef4b05745b41165490914772fbb16fbad8f22" exitCode=0
Sep 11 18:02:07.840805 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:07.840787    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c69872-bhftg" event={"ID":"eac6edcc-4220-4064-ae7f-2a281e81f77d","Type":"ContainerDied","Data":"8bfbf7e41f5f3c9b296e4abda7fef4b05745b41165490914772fbb16fbad8f22"}
Sep 11 18:02:07.841250 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:07.840870    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c69872-bhftg" event={"ID":"eac6edcc-4220-4064-ae7f-2a281e81f77d","Type":"ContainerStarted","Data":"4ea1890d21965a9a1dabdbe2ca04d287ac72212249dc54ff8437aeff4433d2a7"}
Sep 11 18:02:08.979171 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:08.979143    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c69872-bhftg"
Sep 11 18:02:09.028696 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:09.028654    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eac6edcc-4220-4064-ae7f-2a281e81f77d-maas-api-service-ca\") pod \"eac6edcc-4220-4064-ae7f-2a281e81f77d\" (UID: \"eac6edcc-4220-4064-ae7f-2a281e81f77d\") "
Sep 11 18:02:09.029012 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:09.028987    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eac6edcc-4220-4064-ae7f-2a281e81f77d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eac6edcc-4220-4064-ae7f-2a281e81f77d" (UID: "eac6edcc-4220-4064-ae7f-2a281e81f77d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:02:09.129856 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:09.129770    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eac6edcc-4220-4064-ae7f-2a281e81f77d-maas-api-service-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:02:09.852790 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:09.852670    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c69872-bhftg"
Sep 11 18:02:09.852790 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:09.852710    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c69872-bhftg" event={"ID":"eac6edcc-4220-4064-ae7f-2a281e81f77d","Type":"ContainerDied","Data":"4ea1890d21965a9a1dabdbe2ca04d287ac72212249dc54ff8437aeff4433d2a7"}
Sep 11 18:02:09.852790 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:09.852783    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ea1890d21965a9a1dabdbe2ca04d287ac72212249dc54ff8437aeff4433d2a7"
Sep 11 18:02:14.888425 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:14.888395    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"]
Sep 11 18:02:14.888878 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:14.888865    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eac6edcc-4220-4064-ae7f-2a281e81f77d" containerName="revoke-keys"
Sep 11 18:02:14.888878 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:14.888880    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="eac6edcc-4220-4064-ae7f-2a281e81f77d" containerName="revoke-keys"
Sep 11 18:02:14.888968 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:14.888946    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="eac6edcc-4220-4064-ae7f-2a281e81f77d" containerName="revoke-keys"
Sep 11 18:02:14.891484 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:14.891466    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:14.897304 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:14.897280    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-045ac32d-openshift-default-dockercfg-fw6qw\""
Sep 11 18:02:14.921428 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:14.921393    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"]
Sep 11 18:02:14.994605 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:14.994565    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-istio-envoy\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:14.994928 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:14.994907    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7995be1c-0190-4051-9fa8-f7e48250c792-istiod-ca-cert\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:14.995084 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:14.995070    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-istio-data\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:14.995261 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:14.995245    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-credential-socket\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:14.995432 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:14.995415    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7995be1c-0190-4051-9fa8-f7e48250c792-istio-podinfo\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:14.995680 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:14.995663    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-workload-socket\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:14.995860 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:14.995845    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7995be1c-0190-4051-9fa8-f7e48250c792-istio-token\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:14.996000 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:14.995984    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbdpn\" (UniqueName: \"kubernetes.io/projected/7995be1c-0190-4051-9fa8-f7e48250c792-kube-api-access-dbdpn\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:14.996135 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:14.996120    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-workload-certs\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:15.097477 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.097433    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-workload-socket\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:15.097477 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.097483    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7995be1c-0190-4051-9fa8-f7e48250c792-istio-token\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:15.097741 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.097608    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbdpn\" (UniqueName: \"kubernetes.io/projected/7995be1c-0190-4051-9fa8-f7e48250c792-kube-api-access-dbdpn\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:15.097741 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.097728    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-workload-certs\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:15.097903 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.097803    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-istio-envoy\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:15.097903 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.097846    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7995be1c-0190-4051-9fa8-f7e48250c792-istiod-ca-cert\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:15.097903 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.097873    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-istio-data\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:15.098063 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.097946    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-credential-socket\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:15.098063 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.097953    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-workload-socket\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:15.098063 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.098007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7995be1c-0190-4051-9fa8-f7e48250c792-istio-podinfo\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:15.098224 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.098064    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-workload-certs\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:15.098284 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.098227    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-istio-data\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:15.098284 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.098263    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-credential-socket\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:15.098556 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.098533    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7995be1c-0190-4051-9fa8-f7e48250c792-istiod-ca-cert\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:15.100028 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.100008    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-istio-envoy\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:15.100462 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.100445    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7995be1c-0190-4051-9fa8-f7e48250c792-istio-podinfo\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:15.109914 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.109888    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7995be1c-0190-4051-9fa8-f7e48250c792-istio-token\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:15.111345 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.111323    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbdpn\" (UniqueName: \"kubernetes.io/projected/7995be1c-0190-4051-9fa8-f7e48250c792-kube-api-access-dbdpn\") pod \"e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") " pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:15.201201 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.201115    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:15.484225 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.484195    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"]
Sep 11 18:02:15.485522 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:02:15.485493    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7995be1c_0190_4051_9fa8_f7e48250c792.slice/crio-ef1ed61053b5969c55c547c141d5281568b366f5e3313261ec743dea9b6451f9 WatchSource:0}: Error finding container ef1ed61053b5969c55c547c141d5281568b366f5e3313261ec743dea9b6451f9: Status 404 returned error can't find the container with id ef1ed61053b5969c55c547c141d5281568b366f5e3313261ec743dea9b6451f9
Sep 11 18:02:15.488481 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.488443    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:02:15.488562 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.488536    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:02:15.488606 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.488577    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:02:15.890851 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.890814    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr" event={"ID":"7995be1c-0190-4051-9fa8-f7e48250c792","Type":"ContainerStarted","Data":"abbae18014e17162e3521cf8df0a8a813b7a2dd2dfb4fc8374900ef7d5fade91"}
Sep 11 18:02:15.891275 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.890868    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr" event={"ID":"7995be1c-0190-4051-9fa8-f7e48250c792","Type":"ContainerStarted","Data":"ef1ed61053b5969c55c547c141d5281568b366f5e3313261ec743dea9b6451f9"}
Sep 11 18:02:15.925334 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:15.925264    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr" podStartSLOduration=1.9252445150000002 podStartE2EDuration="1.925244515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:02:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:02:15.923396355 +0000 UTC m=+1028.849348101" watchObservedRunningTime="2026-09-11 18:02:15.925244515 +0000 UTC m=+1028.851196260"
Sep 11 18:02:16.202048 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:16.201961    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:16.207320 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:16.207291    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:16.897004 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:16.896966    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:16.898117 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:16.898099    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:20.846916 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:20.846881    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn"]
Sep 11 18:02:20.847366 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:20.847136    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn" podUID="ee155865-94d9-45f3-8d64-dd99eb5ebfb9" containerName="payload-pre-processing" containerID="cri-o://8c7623ee815cc75ef65b6e2b633a0656df09ccac76b01ca62aeaa74af91b3484" gracePeriod=30
Sep 11 18:02:21.132052 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:21.132024    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn"
Sep 11 18:02:21.243222 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:21.243186    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c69872-bhftg"]
Sep 11 18:02:21.255871 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:21.255828    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c69872-bhftg"]
Sep 11 18:02:21.264308 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:21.264273    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lp5hw\" (UniqueName: \"kubernetes.io/projected/ee155865-94d9-45f3-8d64-dd99eb5ebfb9-kube-api-access-lp5hw\") pod \"ee155865-94d9-45f3-8d64-dd99eb5ebfb9\" (UID: \"ee155865-94d9-45f3-8d64-dd99eb5ebfb9\") "
Sep 11 18:02:21.264494 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:21.264350    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee155865-94d9-45f3-8d64-dd99eb5ebfb9-plugins-config-volume\") pod \"ee155865-94d9-45f3-8d64-dd99eb5ebfb9\" (UID: \"ee155865-94d9-45f3-8d64-dd99eb5ebfb9\") "
Sep 11 18:02:21.264739 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:21.264713    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee155865-94d9-45f3-8d64-dd99eb5ebfb9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ee155865-94d9-45f3-8d64-dd99eb5ebfb9" (UID: "ee155865-94d9-45f3-8d64-dd99eb5ebfb9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:02:21.267176 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:21.267140    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee155865-94d9-45f3-8d64-dd99eb5ebfb9-kube-api-access-lp5hw" (OuterVolumeSpecName: "kube-api-access-lp5hw") pod "ee155865-94d9-45f3-8d64-dd99eb5ebfb9" (UID: "ee155865-94d9-45f3-8d64-dd99eb5ebfb9"). InnerVolumeSpecName "kube-api-access-lp5hw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:02:21.366340 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:21.366252    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lp5hw\" (UniqueName: \"kubernetes.io/projected/ee155865-94d9-45f3-8d64-dd99eb5ebfb9-kube-api-access-lp5hw\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:02:21.366340 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:21.366283    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee155865-94d9-45f3-8d64-dd99eb5ebfb9-plugins-config-volume\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:02:21.534678 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:21.534645    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eac6edcc-4220-4064-ae7f-2a281e81f77d" path="/var/lib/kubelet/pods/eac6edcc-4220-4064-ae7f-2a281e81f77d/volumes"
Sep 11 18:02:21.928206 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:21.928171    2579 generic.go:356] "Generic (PLEG): container finished" podID="ee155865-94d9-45f3-8d64-dd99eb5ebfb9" containerID="8c7623ee815cc75ef65b6e2b633a0656df09ccac76b01ca62aeaa74af91b3484" exitCode=0
Sep 11 18:02:21.928692 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:21.928220    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn"
Sep 11 18:02:21.928692 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:21.928258    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn" event={"ID":"ee155865-94d9-45f3-8d64-dd99eb5ebfb9","Type":"ContainerDied","Data":"8c7623ee815cc75ef65b6e2b633a0656df09ccac76b01ca62aeaa74af91b3484"}
Sep 11 18:02:21.928692 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:21.928332    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn" event={"ID":"ee155865-94d9-45f3-8d64-dd99eb5ebfb9","Type":"ContainerDied","Data":"aa964861794a31131933463f63cf37b05c97a5a58e06a52c8081275466b2dc13"}
Sep 11 18:02:21.928692 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:21.928349    2579 scope.go:117] "RemoveContainer" containerID="8c7623ee815cc75ef65b6e2b633a0656df09ccac76b01ca62aeaa74af91b3484"
Sep 11 18:02:21.937870 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:21.937841    2579 scope.go:117] "RemoveContainer" containerID="8c7623ee815cc75ef65b6e2b633a0656df09ccac76b01ca62aeaa74af91b3484"
Sep 11 18:02:21.938141 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:02:21.938121    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c7623ee815cc75ef65b6e2b633a0656df09ccac76b01ca62aeaa74af91b3484\": container with ID starting with 8c7623ee815cc75ef65b6e2b633a0656df09ccac76b01ca62aeaa74af91b3484 not found: ID does not exist" containerID="8c7623ee815cc75ef65b6e2b633a0656df09ccac76b01ca62aeaa74af91b3484"
Sep 11 18:02:21.938200 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:21.938150    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c7623ee815cc75ef65b6e2b633a0656df09ccac76b01ca62aeaa74af91b3484"} err="failed to get container status \"8c7623ee815cc75ef65b6e2b633a0656df09ccac76b01ca62aeaa74af91b3484\": rpc error: code = NotFound desc = could not find container \"8c7623ee815cc75ef65b6e2b633a0656df09ccac76b01ca62aeaa74af91b3484\": container with ID starting with 8c7623ee815cc75ef65b6e2b633a0656df09ccac76b01ca62aeaa74af91b3484 not found: ID does not exist"
Sep 11 18:02:21.953675 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:21.953647    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn"]
Sep 11 18:02:21.963366 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:21.963329    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn"]
Sep 11 18:02:23.541193 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:23.541162    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee155865-94d9-45f3-8d64-dd99eb5ebfb9" path="/var/lib/kubelet/pods/ee155865-94d9-45f3-8d64-dd99eb5ebfb9/volumes"
Sep 11 18:02:31.363403 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:31.363368    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"]
Sep 11 18:02:31.363909 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:31.363664    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6" podUID="bc13248b-66ff-4929-a9b4-49a634219b61" containerName="istio-proxy" containerID="cri-o://6b56dbf74c66ae3d070cd17946614ec6f900638e2e8dfd8303cef62f77d923ea" gracePeriod=30
Sep 11 18:02:32.340810 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.340737    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"]
Sep 11 18:02:32.341290 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.341270    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee155865-94d9-45f3-8d64-dd99eb5ebfb9" containerName="payload-pre-processing"
Sep 11 18:02:32.341409 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.341292    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee155865-94d9-45f3-8d64-dd99eb5ebfb9" containerName="payload-pre-processing"
Sep 11 18:02:32.341467 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.341432    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee155865-94d9-45f3-8d64-dd99eb5ebfb9" containerName="payload-pre-processing"
Sep 11 18:02:32.344434 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.344414    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.359626 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.359606    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-c0ad9c-openshift-default-dockercfg-4jbxr\""
Sep 11 18:02:32.410793 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.408158    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"]
Sep 11 18:02:32.508785 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.508392    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2295m\" (UniqueName: \"kubernetes.io/projected/e7cc282c-e4e6-4a90-b240-54c992780052-kube-api-access-2295m\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.508785 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.508458    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7cc282c-e4e6-4a90-b240-54c992780052-istio-podinfo\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.508785 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.508503    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-istio-envoy\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.508785 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.508556    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7cc282c-e4e6-4a90-b240-54c992780052-istiod-ca-cert\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.508785 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.508605    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-credential-socket\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.508785 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.508677    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-istio-data\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.508785 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.508707    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-workload-socket\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.508785 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.508782    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-workload-certs\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.509406 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.508848    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7cc282c-e4e6-4a90-b240-54c992780052-istio-token\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.610081 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.609977    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-istio-data\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.610081 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.610036    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-workload-socket\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.610320 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.610092    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-workload-certs\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.610320 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.610138    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7cc282c-e4e6-4a90-b240-54c992780052-istio-token\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.610320 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.610169    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2295m\" (UniqueName: \"kubernetes.io/projected/e7cc282c-e4e6-4a90-b240-54c992780052-kube-api-access-2295m\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.610320 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.610214    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7cc282c-e4e6-4a90-b240-54c992780052-istio-podinfo\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.610320 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.610254    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-istio-envoy\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.610320 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.610312    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7cc282c-e4e6-4a90-b240-54c992780052-istiod-ca-cert\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.610648 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.610363    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-credential-socket\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.610912 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.610882    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-credential-socket\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.611172 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.611150    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-istio-data\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.611410 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.611389    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-workload-socket\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.611658 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.611637    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-workload-certs\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.613891 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.613861    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7cc282c-e4e6-4a90-b240-54c992780052-istiod-ca-cert\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.615869 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.615824    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-istio-envoy\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.616092 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.616073    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7cc282c-e4e6-4a90-b240-54c992780052-istio-podinfo\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.687077 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.687045    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7cc282c-e4e6-4a90-b240-54c992780052-istio-token\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.687298 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.687098    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2295m\" (UniqueName: \"kubernetes.io/projected/e7cc282c-e4e6-4a90-b240-54c992780052-kube-api-access-2295m\") pod \"e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") " pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:32.954344 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:32.954260    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:33.294190 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:33.294142    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"]
Sep 11 18:02:33.298063 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:02:33.298018    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7cc282c_e4e6_4a90_b240_54c992780052.slice/crio-e11eb51009bfdeec8589f6c7bcd25d8c8354e907ded6de04c2dc701b7b019e20 WatchSource:0}: Error finding container e11eb51009bfdeec8589f6c7bcd25d8c8354e907ded6de04c2dc701b7b019e20: Status 404 returned error can't find the container with id e11eb51009bfdeec8589f6c7bcd25d8c8354e907ded6de04c2dc701b7b019e20
Sep 11 18:02:33.301854 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:33.301814    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:02:33.301958 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:33.301908    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:02:33.302014 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:33.301964    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:02:34.021053 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:34.021017    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm" event={"ID":"e7cc282c-e4e6-4a90-b240-54c992780052","Type":"ContainerStarted","Data":"46558aacb70d7cbe64e7f2810607e63f5e6a97cb65b9cb9255286cca3b652816"}
Sep 11 18:02:34.021457 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:34.021074    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm" event={"ID":"e7cc282c-e4e6-4a90-b240-54c992780052","Type":"ContainerStarted","Data":"e11eb51009bfdeec8589f6c7bcd25d8c8354e907ded6de04c2dc701b7b019e20"}
Sep 11 18:02:34.054681 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:34.054645    2579 patch_prober.go:28] interesting pod/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 18:02:34.054857 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:34.054703    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6" podUID="bc13248b-66ff-4929-a9b4-49a634219b61" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 18:02:34.075373 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:34.075316    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm" podStartSLOduration=2.075298714 podStartE2EDuration="2.075298714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:02:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:02:34.0731019 +0000 UTC m=+1046.999053646" watchObservedRunningTime="2026-09-11 18:02:34.075298714 +0000 UTC m=+1047.001250523"
Sep 11 18:02:34.955095 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:34.955059    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:34.960620 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:34.960593    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:35.026807 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:35.026773    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:35.027841 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:35.027817    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:02:36.631990 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.631922    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:02:36.757349 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.757317    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-istio-envoy\") pod \"bc13248b-66ff-4929-a9b4-49a634219b61\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") "
Sep 11 18:02:36.757540 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.757365    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-workload-socket\") pod \"bc13248b-66ff-4929-a9b4-49a634219b61\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") "
Sep 11 18:02:36.757540 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.757395    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc13248b-66ff-4929-a9b4-49a634219b61-istio-podinfo\") pod \"bc13248b-66ff-4929-a9b4-49a634219b61\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") "
Sep 11 18:02:36.757540 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.757445    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc13248b-66ff-4929-a9b4-49a634219b61-istio-token\") pod \"bc13248b-66ff-4929-a9b4-49a634219b61\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") "
Sep 11 18:02:36.757540 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.757480    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-istio-data\") pod \"bc13248b-66ff-4929-a9b4-49a634219b61\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") "
Sep 11 18:02:36.757540 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.757533    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-credential-socket\") pod \"bc13248b-66ff-4929-a9b4-49a634219b61\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") "
Sep 11 18:02:36.757833 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.757567    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ng8t8\" (UniqueName: \"kubernetes.io/projected/bc13248b-66ff-4929-a9b4-49a634219b61-kube-api-access-ng8t8\") pod \"bc13248b-66ff-4929-a9b4-49a634219b61\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") "
Sep 11 18:02:36.757833 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.757606    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc13248b-66ff-4929-a9b4-49a634219b61-istiod-ca-cert\") pod \"bc13248b-66ff-4929-a9b4-49a634219b61\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") "
Sep 11 18:02:36.757833 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.757621    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-workload-certs\") pod \"bc13248b-66ff-4929-a9b4-49a634219b61\" (UID: \"bc13248b-66ff-4929-a9b4-49a634219b61\") "
Sep 11 18:02:36.758000 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.757901    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc13248b-66ff-4929-a9b4-49a634219b61" (UID: "bc13248b-66ff-4929-a9b4-49a634219b61"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:02:36.758059 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.758012    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc13248b-66ff-4929-a9b4-49a634219b61" (UID: "bc13248b-66ff-4929-a9b4-49a634219b61"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:02:36.758114 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.758054    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-workload-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:02:36.758170 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.758118    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc13248b-66ff-4929-a9b4-49a634219b61" (UID: "bc13248b-66ff-4929-a9b4-49a634219b61"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:02:36.758170 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.758152    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc13248b-66ff-4929-a9b4-49a634219b61" (UID: "bc13248b-66ff-4929-a9b4-49a634219b61"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:02:36.758528 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.758434    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc13248b-66ff-4929-a9b4-49a634219b61-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc13248b-66ff-4929-a9b4-49a634219b61" (UID: "bc13248b-66ff-4929-a9b4-49a634219b61"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:02:36.760038 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.759991    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc13248b-66ff-4929-a9b4-49a634219b61-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc13248b-66ff-4929-a9b4-49a634219b61" (UID: "bc13248b-66ff-4929-a9b4-49a634219b61"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:02:36.760171 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.760043    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc13248b-66ff-4929-a9b4-49a634219b61-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc13248b-66ff-4929-a9b4-49a634219b61" (UID: "bc13248b-66ff-4929-a9b4-49a634219b61"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:02:36.760171 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.760080    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc13248b-66ff-4929-a9b4-49a634219b61" (UID: "bc13248b-66ff-4929-a9b4-49a634219b61"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:02:36.760294 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.760252    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc13248b-66ff-4929-a9b4-49a634219b61-kube-api-access-ng8t8" (OuterVolumeSpecName: "kube-api-access-ng8t8") pod "bc13248b-66ff-4929-a9b4-49a634219b61" (UID: "bc13248b-66ff-4929-a9b4-49a634219b61"). InnerVolumeSpecName "kube-api-access-ng8t8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:02:36.858779 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.858736    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc13248b-66ff-4929-a9b4-49a634219b61-istiod-ca-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:02:36.858950 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.858797    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-workload-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:02:36.858950 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.858809    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-istio-envoy\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:02:36.858950 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.858817    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc13248b-66ff-4929-a9b4-49a634219b61-istio-podinfo\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:02:36.858950 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.858827    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc13248b-66ff-4929-a9b4-49a634219b61-istio-token\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:02:36.858950 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.858836    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-istio-data\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:02:36.858950 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.858843    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc13248b-66ff-4929-a9b4-49a634219b61-credential-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:02:36.858950 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:36.858852    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ng8t8\" (UniqueName: \"kubernetes.io/projected/bc13248b-66ff-4929-a9b4-49a634219b61-kube-api-access-ng8t8\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:02:37.041117 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:37.041078    2579 generic.go:356] "Generic (PLEG): container finished" podID="bc13248b-66ff-4929-a9b4-49a634219b61" containerID="6b56dbf74c66ae3d070cd17946614ec6f900638e2e8dfd8303cef62f77d923ea" exitCode=0
Sep 11 18:02:37.041294 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:37.041142    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"
Sep 11 18:02:37.041294 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:37.041167    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6" event={"ID":"bc13248b-66ff-4929-a9b4-49a634219b61","Type":"ContainerDied","Data":"6b56dbf74c66ae3d070cd17946614ec6f900638e2e8dfd8303cef62f77d923ea"}
Sep 11 18:02:37.041294 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:37.041231    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6" event={"ID":"bc13248b-66ff-4929-a9b4-49a634219b61","Type":"ContainerDied","Data":"a6c05f8c73c9c4d054e4f41788a71b721c831b9658ca446fd205aaf36172ff97"}
Sep 11 18:02:37.041294 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:37.041245    2579 scope.go:117] "RemoveContainer" containerID="6b56dbf74c66ae3d070cd17946614ec6f900638e2e8dfd8303cef62f77d923ea"
Sep 11 18:02:37.051478 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:37.051461    2579 scope.go:117] "RemoveContainer" containerID="4f944e6ff8597721d10a3adaa80f85ae403a85b8b12b488499ad2df5953943bf"
Sep 11 18:02:37.060381 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:37.060360    2579 scope.go:117] "RemoveContainer" containerID="6b56dbf74c66ae3d070cd17946614ec6f900638e2e8dfd8303cef62f77d923ea"
Sep 11 18:02:37.060683 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:02:37.060662    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b56dbf74c66ae3d070cd17946614ec6f900638e2e8dfd8303cef62f77d923ea\": container with ID starting with 6b56dbf74c66ae3d070cd17946614ec6f900638e2e8dfd8303cef62f77d923ea not found: ID does not exist" containerID="6b56dbf74c66ae3d070cd17946614ec6f900638e2e8dfd8303cef62f77d923ea"
Sep 11 18:02:37.060792 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:37.060696    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b56dbf74c66ae3d070cd17946614ec6f900638e2e8dfd8303cef62f77d923ea"} err="failed to get container status \"6b56dbf74c66ae3d070cd17946614ec6f900638e2e8dfd8303cef62f77d923ea\": rpc error: code = NotFound desc = could not find container \"6b56dbf74c66ae3d070cd17946614ec6f900638e2e8dfd8303cef62f77d923ea\": container with ID starting with 6b56dbf74c66ae3d070cd17946614ec6f900638e2e8dfd8303cef62f77d923ea not found: ID does not exist"
Sep 11 18:02:37.060792 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:37.060721    2579 scope.go:117] "RemoveContainer" containerID="4f944e6ff8597721d10a3adaa80f85ae403a85b8b12b488499ad2df5953943bf"
Sep 11 18:02:37.061035 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:02:37.061013    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f944e6ff8597721d10a3adaa80f85ae403a85b8b12b488499ad2df5953943bf\": container with ID starting with 4f944e6ff8597721d10a3adaa80f85ae403a85b8b12b488499ad2df5953943bf not found: ID does not exist" containerID="4f944e6ff8597721d10a3adaa80f85ae403a85b8b12b488499ad2df5953943bf"
Sep 11 18:02:37.061075 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:37.061043    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f944e6ff8597721d10a3adaa80f85ae403a85b8b12b488499ad2df5953943bf"} err="failed to get container status \"4f944e6ff8597721d10a3adaa80f85ae403a85b8b12b488499ad2df5953943bf\": rpc error: code = NotFound desc = could not find container \"4f944e6ff8597721d10a3adaa80f85ae403a85b8b12b488499ad2df5953943bf\": container with ID starting with 4f944e6ff8597721d10a3adaa80f85ae403a85b8b12b488499ad2df5953943bf not found: ID does not exist"
Sep 11 18:02:37.071383 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:37.071351    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"]
Sep 11 18:02:37.077899 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:37.077868    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6"]
Sep 11 18:02:37.535176 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:37.535140    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc13248b-66ff-4929-a9b4-49a634219b61" path="/var/lib/kubelet/pods/bc13248b-66ff-4929-a9b4-49a634219b61/volumes"
Sep 11 18:02:40.061498 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:40.061464    2579 generic.go:356] "Generic (PLEG): container finished" podID="7995be1c-0190-4051-9fa8-f7e48250c792" containerID="abbae18014e17162e3521cf8df0a8a813b7a2dd2dfb4fc8374900ef7d5fade91" exitCode=0
Sep 11 18:02:40.061498 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:40.061502    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr" event={"ID":"7995be1c-0190-4051-9fa8-f7e48250c792","Type":"ContainerDied","Data":"abbae18014e17162e3521cf8df0a8a813b7a2dd2dfb4fc8374900ef7d5fade91"}
Sep 11 18:02:40.061990 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:40.061917    2579 scope.go:117] "RemoveContainer" containerID="abbae18014e17162e3521cf8df0a8a813b7a2dd2dfb4fc8374900ef7d5fade91"
Sep 11 18:02:40.062966 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:40.062939    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:02:40.063023 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:40.063004    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:02:40.063061 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:40.063037    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:02:41.070041 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:41.070008    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr" event={"ID":"7995be1c-0190-4051-9fa8-f7e48250c792","Type":"ContainerStarted","Data":"1c3ea84ca1d0a63c20392a926e5c816c5022c9c02b2dd6fef94f9091e8b1d6f0"}
Sep 11 18:02:41.201475 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:41.201432    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:41.201673 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:41.201649    2579 patch_prober.go:28] interesting pod/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 11 18:02:41.201724 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:41.201698    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr" podUID="7995be1c-0190-4051-9fa8-f7e48250c792" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 11 18:02:42.201886 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:42.201846    2579 patch_prober.go:28] interesting pod/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 11 18:02:42.202485 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:42.202454    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr" podUID="7995be1c-0190-4051-9fa8-f7e48250c792" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 11 18:02:43.202200 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:43.202159    2579 patch_prober.go:28] interesting pod/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 11 18:02:43.202826 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:43.202787    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr" podUID="7995be1c-0190-4051-9fa8-f7e48250c792" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 11 18:02:44.202466 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:44.202424    2579 patch_prober.go:28] interesting pod/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 11 18:02:44.203094 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:44.203057    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr" podUID="7995be1c-0190-4051-9fa8-f7e48250c792" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 11 18:02:45.202376 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:45.202337    2579 patch_prober.go:28] interesting pod/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 11 18:02:45.202695 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:45.202657    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr" podUID="7995be1c-0190-4051-9fa8-f7e48250c792" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 11 18:02:46.201907 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:46.201797    2579 patch_prober.go:28] interesting pod/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 11 18:02:46.202107 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:46.201934    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr" podUID="7995be1c-0190-4051-9fa8-f7e48250c792" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 11 18:02:46.897205 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:46.897154    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:47.206284 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:47.206203    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:47.207282 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:47.207262    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:02:57.229753 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:57.229716    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-045ac32d-9qmmb"]
Sep 11 18:02:57.230188 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:57.230174    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc13248b-66ff-4929-a9b4-49a634219b61" containerName="istio-proxy"
Sep 11 18:02:57.230188 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:57.230189    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc13248b-66ff-4929-a9b4-49a634219b61" containerName="istio-proxy"
Sep 11 18:02:57.230264 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:57.230206    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc13248b-66ff-4929-a9b4-49a634219b61" containerName="istio-proxy"
Sep 11 18:02:57.230264 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:57.230212    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc13248b-66ff-4929-a9b4-49a634219b61" containerName="istio-proxy"
Sep 11 18:02:57.230336 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:57.230280    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc13248b-66ff-4929-a9b4-49a634219b61" containerName="istio-proxy"
Sep 11 18:02:57.230336 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:57.230288    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc13248b-66ff-4929-a9b4-49a634219b61" containerName="istio-proxy"
Sep 11 18:02:57.232634 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:57.232613    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-045ac32d-9qmmb"
Sep 11 18:02:57.235543 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:57.235516    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 18:02:57.235699 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:57.235558    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 18:02:57.254461 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:57.254425    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-045ac32d-9qmmb"]
Sep 11 18:02:57.378590 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:57.378552    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cf96945-9d0d-4325-b648-875cfb0e5abd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-045ac32d-9qmmb\" (UID: \"6cf96945-9d0d-4325-b648-875cfb0e5abd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-045ac32d-9qmmb"
Sep 11 18:02:57.480337 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:57.480241    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cf96945-9d0d-4325-b648-875cfb0e5abd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-045ac32d-9qmmb\" (UID: \"6cf96945-9d0d-4325-b648-875cfb0e5abd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-045ac32d-9qmmb"
Sep 11 18:02:57.480944 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:57.480924    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cf96945-9d0d-4325-b648-875cfb0e5abd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-045ac32d-9qmmb\" (UID: \"6cf96945-9d0d-4325-b648-875cfb0e5abd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-045ac32d-9qmmb"
Sep 11 18:02:57.543431 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:57.543401    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-045ac32d-9qmmb"
Sep 11 18:02:57.823971 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:57.823944    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-045ac32d-9qmmb"]
Sep 11 18:02:57.826492 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:02:57.826461    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf96945_9d0d_4325_b648_875cfb0e5abd.slice/crio-ac84a47aa937d25964245761757dce1d534332278e2f8dd99181d72571c3f2e2 WatchSource:0}: Error finding container ac84a47aa937d25964245761757dce1d534332278e2f8dd99181d72571c3f2e2: Status 404 returned error can't find the container with id ac84a47aa937d25964245761757dce1d534332278e2f8dd99181d72571c3f2e2
Sep 11 18:02:58.181775 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:58.181714    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-045ac32d-9qmmb" event={"ID":"6cf96945-9d0d-4325-b648-875cfb0e5abd","Type":"ContainerStarted","Data":"ac84a47aa937d25964245761757dce1d534332278e2f8dd99181d72571c3f2e2"}
Sep 11 18:02:58.345290 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:58.345257    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"]
Sep 11 18:02:58.345776 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:58.345521    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm" podUID="e7cc282c-e4e6-4a90-b240-54c992780052" containerName="istio-proxy" containerID="cri-o://46558aacb70d7cbe64e7f2810607e63f5e6a97cb65b9cb9255286cca3b652816" gracePeriod=30
Sep 11 18:02:59.189692 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:59.189652    2579 generic.go:356] "Generic (PLEG): container finished" podID="6cf96945-9d0d-4325-b648-875cfb0e5abd" containerID="9fdb243bd5e730909a63fe13973310e526cd4b200067a2c3a987720fc3c7450c" exitCode=0
Sep 11 18:02:59.189886 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:02:59.189737    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-045ac32d-9qmmb" event={"ID":"6cf96945-9d0d-4325-b648-875cfb0e5abd","Type":"ContainerDied","Data":"9fdb243bd5e730909a63fe13973310e526cd4b200067a2c3a987720fc3c7450c"}
Sep 11 18:03:00.337301 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:00.337275    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-045ac32d-9qmmb"
Sep 11 18:03:00.410411 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:00.410383    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cf96945-9d0d-4325-b648-875cfb0e5abd-maas-api-service-ca\") pod \"6cf96945-9d0d-4325-b648-875cfb0e5abd\" (UID: \"6cf96945-9d0d-4325-b648-875cfb0e5abd\") "
Sep 11 18:03:00.410713 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:00.410692    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cf96945-9d0d-4325-b648-875cfb0e5abd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6cf96945-9d0d-4325-b648-875cfb0e5abd" (UID: "6cf96945-9d0d-4325-b648-875cfb0e5abd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:03:00.511955 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:00.511923    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cf96945-9d0d-4325-b648-875cfb0e5abd-maas-api-service-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:01.203226 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:01.203195    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-045ac32d-9qmmb"
Sep 11 18:03:01.203226 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:01.203204    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-045ac32d-9qmmb" event={"ID":"6cf96945-9d0d-4325-b648-875cfb0e5abd","Type":"ContainerDied","Data":"ac84a47aa937d25964245761757dce1d534332278e2f8dd99181d72571c3f2e2"}
Sep 11 18:03:01.203482 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:01.203249    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac84a47aa937d25964245761757dce1d534332278e2f8dd99181d72571c3f2e2"
Sep 11 18:03:01.313822 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:01.313784    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-67477b-d5vf5"]
Sep 11 18:03:01.314237 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:01.314225    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cf96945-9d0d-4325-b648-875cfb0e5abd" containerName="revoke-keys"
Sep 11 18:03:01.314281 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:01.314238    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cf96945-9d0d-4325-b648-875cfb0e5abd" containerName="revoke-keys"
Sep 11 18:03:01.314333 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:01.314325    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cf96945-9d0d-4325-b648-875cfb0e5abd" containerName="revoke-keys"
Sep 11 18:03:01.316566 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:01.316550    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-67477b-d5vf5"
Sep 11 18:03:01.320175 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:01.320151    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 18:03:01.320748 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:01.320727    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 18:03:01.334852 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:01.334825    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-67477b-d5vf5"]
Sep 11 18:03:01.421817 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:01.421783    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c97a1328-d348-4041-bece-b7006425c2be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-67477b-d5vf5\" (UID: \"c97a1328-d348-4041-bece-b7006425c2be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-67477b-d5vf5"
Sep 11 18:03:01.523109 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:01.523069    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c97a1328-d348-4041-bece-b7006425c2be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-67477b-d5vf5\" (UID: \"c97a1328-d348-4041-bece-b7006425c2be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-67477b-d5vf5"
Sep 11 18:03:01.523737 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:01.523711    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c97a1328-d348-4041-bece-b7006425c2be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-67477b-d5vf5\" (UID: \"c97a1328-d348-4041-bece-b7006425c2be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-67477b-d5vf5"
Sep 11 18:03:01.626474 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:01.626445    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-67477b-d5vf5"
Sep 11 18:03:01.908919 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:01.908892    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-67477b-d5vf5"]
Sep 11 18:03:01.910284 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:03:01.910259    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc97a1328_d348_4041_bece_b7006425c2be.slice/crio-ee6eab050e0356df3f286345c4009e03ec9ae8554c3bfd5a900797c0a2cfa9a4 WatchSource:0}: Error finding container ee6eab050e0356df3f286345c4009e03ec9ae8554c3bfd5a900797c0a2cfa9a4: Status 404 returned error can't find the container with id ee6eab050e0356df3f286345c4009e03ec9ae8554c3bfd5a900797c0a2cfa9a4
Sep 11 18:03:02.210280 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:02.210247    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-67477b-d5vf5" event={"ID":"c97a1328-d348-4041-bece-b7006425c2be","Type":"ContainerStarted","Data":"a032f4869084e598cd505e099cf09a554cb94b81457eee0a16bdff50cf33320e"}
Sep 11 18:03:02.210427 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:02.210297    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-67477b-d5vf5" event={"ID":"c97a1328-d348-4041-bece-b7006425c2be","Type":"ContainerStarted","Data":"ee6eab050e0356df3f286345c4009e03ec9ae8554c3bfd5a900797c0a2cfa9a4"}
Sep 11 18:03:03.217678 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.217637    2579 generic.go:356] "Generic (PLEG): container finished" podID="c97a1328-d348-4041-bece-b7006425c2be" containerID="a032f4869084e598cd505e099cf09a554cb94b81457eee0a16bdff50cf33320e" exitCode=0
Sep 11 18:03:03.218099 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.217728    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-67477b-d5vf5" event={"ID":"c97a1328-d348-4041-bece-b7006425c2be","Type":"ContainerDied","Data":"a032f4869084e598cd505e099cf09a554cb94b81457eee0a16bdff50cf33320e"}
Sep 11 18:03:03.600313 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.600288    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:03:03.746975 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.746941    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-workload-certs\") pod \"e7cc282c-e4e6-4a90-b240-54c992780052\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") "
Sep 11 18:03:03.747142 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.747002    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-istio-envoy\") pod \"e7cc282c-e4e6-4a90-b240-54c992780052\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") "
Sep 11 18:03:03.747142 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.747037    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-istio-data\") pod \"e7cc282c-e4e6-4a90-b240-54c992780052\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") "
Sep 11 18:03:03.747142 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.747065    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-workload-socket\") pod \"e7cc282c-e4e6-4a90-b240-54c992780052\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") "
Sep 11 18:03:03.747142 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.747126    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-credential-socket\") pod \"e7cc282c-e4e6-4a90-b240-54c992780052\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") "
Sep 11 18:03:03.747369 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.747154    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2295m\" (UniqueName: \"kubernetes.io/projected/e7cc282c-e4e6-4a90-b240-54c992780052-kube-api-access-2295m\") pod \"e7cc282c-e4e6-4a90-b240-54c992780052\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") "
Sep 11 18:03:03.747369 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.747202    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7cc282c-e4e6-4a90-b240-54c992780052-istio-podinfo\") pod \"e7cc282c-e4e6-4a90-b240-54c992780052\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") "
Sep 11 18:03:03.747369 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.747246    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7cc282c-e4e6-4a90-b240-54c992780052-istiod-ca-cert\") pod \"e7cc282c-e4e6-4a90-b240-54c992780052\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") "
Sep 11 18:03:03.747369 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.747276    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e7cc282c-e4e6-4a90-b240-54c992780052" (UID: "e7cc282c-e4e6-4a90-b240-54c992780052"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:03:03.747578 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.747411    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-istio-data" (OuterVolumeSpecName: "istio-data") pod "e7cc282c-e4e6-4a90-b240-54c992780052" (UID: "e7cc282c-e4e6-4a90-b240-54c992780052"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:03:03.747578 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.747458    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e7cc282c-e4e6-4a90-b240-54c992780052" (UID: "e7cc282c-e4e6-4a90-b240-54c992780052"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:03:03.747578 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.747476    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e7cc282c-e4e6-4a90-b240-54c992780052" (UID: "e7cc282c-e4e6-4a90-b240-54c992780052"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:03:03.747578 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.747531    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7cc282c-e4e6-4a90-b240-54c992780052-istio-token\") pod \"e7cc282c-e4e6-4a90-b240-54c992780052\" (UID: \"e7cc282c-e4e6-4a90-b240-54c992780052\") "
Sep 11 18:03:03.747834 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.747690    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7cc282c-e4e6-4a90-b240-54c992780052-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e7cc282c-e4e6-4a90-b240-54c992780052" (UID: "e7cc282c-e4e6-4a90-b240-54c992780052"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:03:03.747971 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.747953    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-workload-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:03.748045 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.747976    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-credential-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:03.748045 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.747991    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7cc282c-e4e6-4a90-b240-54c992780052-istiod-ca-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:03.748045 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.748004    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-workload-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:03.748045 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.748016    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-istio-data\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:03.749361 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.749335    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7cc282c-e4e6-4a90-b240-54c992780052-kube-api-access-2295m" (OuterVolumeSpecName: "kube-api-access-2295m") pod "e7cc282c-e4e6-4a90-b240-54c992780052" (UID: "e7cc282c-e4e6-4a90-b240-54c992780052"). InnerVolumeSpecName "kube-api-access-2295m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:03:03.749438 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.749367    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7cc282c-e4e6-4a90-b240-54c992780052-istio-token" (OuterVolumeSpecName: "istio-token") pod "e7cc282c-e4e6-4a90-b240-54c992780052" (UID: "e7cc282c-e4e6-4a90-b240-54c992780052"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:03:03.749660 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.749645    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e7cc282c-e4e6-4a90-b240-54c992780052" (UID: "e7cc282c-e4e6-4a90-b240-54c992780052"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:03:03.749726 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.749709    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e7cc282c-e4e6-4a90-b240-54c992780052-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e7cc282c-e4e6-4a90-b240-54c992780052" (UID: "e7cc282c-e4e6-4a90-b240-54c992780052"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:03:03.849596 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.849494    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2295m\" (UniqueName: \"kubernetes.io/projected/e7cc282c-e4e6-4a90-b240-54c992780052-kube-api-access-2295m\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:03.849596 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.849529    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7cc282c-e4e6-4a90-b240-54c992780052-istio-podinfo\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:03.849596 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.849542    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7cc282c-e4e6-4a90-b240-54c992780052-istio-token\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:03.849596 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:03.849554    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7cc282c-e4e6-4a90-b240-54c992780052-istio-envoy\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:04.224603 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:04.224512    2579 generic.go:356] "Generic (PLEG): container finished" podID="e7cc282c-e4e6-4a90-b240-54c992780052" containerID="46558aacb70d7cbe64e7f2810607e63f5e6a97cb65b9cb9255286cca3b652816" exitCode=0
Sep 11 18:03:04.224603 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:04.224565    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"
Sep 11 18:03:04.224603 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:04.224589    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm" event={"ID":"e7cc282c-e4e6-4a90-b240-54c992780052","Type":"ContainerDied","Data":"46558aacb70d7cbe64e7f2810607e63f5e6a97cb65b9cb9255286cca3b652816"}
Sep 11 18:03:04.225184 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:04.224638    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm" event={"ID":"e7cc282c-e4e6-4a90-b240-54c992780052","Type":"ContainerDied","Data":"e11eb51009bfdeec8589f6c7bcd25d8c8354e907ded6de04c2dc701b7b019e20"}
Sep 11 18:03:04.225184 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:04.224660    2579 scope.go:117] "RemoveContainer" containerID="46558aacb70d7cbe64e7f2810607e63f5e6a97cb65b9cb9255286cca3b652816"
Sep 11 18:03:04.236822 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:04.236804    2579 scope.go:117] "RemoveContainer" containerID="46558aacb70d7cbe64e7f2810607e63f5e6a97cb65b9cb9255286cca3b652816"
Sep 11 18:03:04.237118 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:03:04.237093    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46558aacb70d7cbe64e7f2810607e63f5e6a97cb65b9cb9255286cca3b652816\": container with ID starting with 46558aacb70d7cbe64e7f2810607e63f5e6a97cb65b9cb9255286cca3b652816 not found: ID does not exist" containerID="46558aacb70d7cbe64e7f2810607e63f5e6a97cb65b9cb9255286cca3b652816"
Sep 11 18:03:04.237168 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:04.237126    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46558aacb70d7cbe64e7f2810607e63f5e6a97cb65b9cb9255286cca3b652816"} err="failed to get container status \"46558aacb70d7cbe64e7f2810607e63f5e6a97cb65b9cb9255286cca3b652816\": rpc error: code = NotFound desc = could not find container \"46558aacb70d7cbe64e7f2810607e63f5e6a97cb65b9cb9255286cca3b652816\": container with ID starting with 46558aacb70d7cbe64e7f2810607e63f5e6a97cb65b9cb9255286cca3b652816 not found: ID does not exist"
Sep 11 18:03:04.253498 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:04.253461    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"]
Sep 11 18:03:04.256214 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:04.256187    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm"]
Sep 11 18:03:04.356074 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:04.356049    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-67477b-d5vf5"
Sep 11 18:03:04.454971 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:04.454933    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c97a1328-d348-4041-bece-b7006425c2be-maas-api-service-ca\") pod \"c97a1328-d348-4041-bece-b7006425c2be\" (UID: \"c97a1328-d348-4041-bece-b7006425c2be\") "
Sep 11 18:03:04.455343 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:04.455318    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c97a1328-d348-4041-bece-b7006425c2be-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c97a1328-d348-4041-bece-b7006425c2be" (UID: "c97a1328-d348-4041-bece-b7006425c2be"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:03:04.556276 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:04.556244    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c97a1328-d348-4041-bece-b7006425c2be-maas-api-service-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:05.231839 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:05.231812    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-67477b-d5vf5"
Sep 11 18:03:05.231839 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:05.231819    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-67477b-d5vf5" event={"ID":"c97a1328-d348-4041-bece-b7006425c2be","Type":"ContainerDied","Data":"ee6eab050e0356df3f286345c4009e03ec9ae8554c3bfd5a900797c0a2cfa9a4"}
Sep 11 18:03:05.232367 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:05.231871    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee6eab050e0356df3f286345c4009e03ec9ae8554c3bfd5a900797c0a2cfa9a4"
Sep 11 18:03:05.535075 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:05.535040    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7cc282c-e4e6-4a90-b240-54c992780052" path="/var/lib/kubelet/pods/e7cc282c-e4e6-4a90-b240-54c992780052/volumes"
Sep 11 18:03:08.408238 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:08.408198    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-045ac32d-9qmmb"]
Sep 11 18:03:08.422371 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:08.422334    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-045ac32d-9qmmb"]
Sep 11 18:03:09.534891 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:09.534857    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cf96945-9d0d-4325-b648-875cfb0e5abd" path="/var/lib/kubelet/pods/6cf96945-9d0d-4325-b648-875cfb0e5abd/volumes"
Sep 11 18:03:12.730805 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:12.730770    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-67477b-29819160-px78n"]
Sep 11 18:03:12.734029 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:12.734006    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-67477b-29819160-px78n"]
Sep 11 18:03:13.221155 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:13.221120    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-67477b-d5vf5"]
Sep 11 18:03:13.228816 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:13.228774    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-67477b-d5vf5"]
Sep 11 18:03:13.534428 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:13.534389    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c97a1328-d348-4041-bece-b7006425c2be" path="/var/lib/kubelet/pods/c97a1328-d348-4041-bece-b7006425c2be/volumes"
Sep 11 18:03:13.534732 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:13.534719    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4c89cd9-874d-434f-9042-a41459f0de1b" path="/var/lib/kubelet/pods/e4c89cd9-874d-434f-9042-a41459f0de1b/volumes"
Sep 11 18:03:22.243829 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:22.243786    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"]
Sep 11 18:03:22.244252 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:22.243999    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr" podUID="7995be1c-0190-4051-9fa8-f7e48250c792" containerName="istio-proxy" containerID="cri-o://1c3ea84ca1d0a63c20392a926e5c816c5022c9c02b2dd6fef94f9091e8b1d6f0" gracePeriod=30
Sep 11 18:03:23.726830 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:23.726786    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"]
Sep 11 18:03:23.727296 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:23.727009    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw" podUID="5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" containerName="istio-proxy" containerID="cri-o://2865a713d7fc9f11f133c823c718a6c48957b82ca046cb9342bfbb2b78bcce3c" gracePeriod=30
Sep 11 18:03:24.297750 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:24.297711    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fb8c5d-gzqlh"]
Sep 11 18:03:24.298210 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:24.298195    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7cc282c-e4e6-4a90-b240-54c992780052" containerName="istio-proxy"
Sep 11 18:03:24.298260 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:24.298213    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7cc282c-e4e6-4a90-b240-54c992780052" containerName="istio-proxy"
Sep 11 18:03:24.298260 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:24.298223    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c97a1328-d348-4041-bece-b7006425c2be" containerName="revoke-keys"
Sep 11 18:03:24.298260 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:24.298228    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c97a1328-d348-4041-bece-b7006425c2be" containerName="revoke-keys"
Sep 11 18:03:24.298362 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:24.298285    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7cc282c-e4e6-4a90-b240-54c992780052" containerName="istio-proxy"
Sep 11 18:03:24.298362 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:24.298298    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c97a1328-d348-4041-bece-b7006425c2be" containerName="revoke-keys"
Sep 11 18:03:24.301383 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:24.301367    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fb8c5d-gzqlh"
Sep 11 18:03:24.309478 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:24.309453    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 18:03:24.310066 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:24.310048    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 18:03:24.340622 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:24.340580    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fb8c5d-gzqlh"]
Sep 11 18:03:24.353644 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:24.353612    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb5876dc-2022-4082-bbdc-777b4e452e58-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-fb8c5d-gzqlh\" (UID: \"fb5876dc-2022-4082-bbdc-777b4e452e58\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fb8c5d-gzqlh"
Sep 11 18:03:24.454629 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:24.454594    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb5876dc-2022-4082-bbdc-777b4e452e58-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-fb8c5d-gzqlh\" (UID: \"fb5876dc-2022-4082-bbdc-777b4e452e58\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fb8c5d-gzqlh"
Sep 11 18:03:24.455245 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:24.455221    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb5876dc-2022-4082-bbdc-777b4e452e58-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-fb8c5d-gzqlh\" (UID: \"fb5876dc-2022-4082-bbdc-777b4e452e58\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fb8c5d-gzqlh"
Sep 11 18:03:24.612484 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:24.612391    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fb8c5d-gzqlh"
Sep 11 18:03:24.899395 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:24.899365    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fb8c5d-gzqlh"]
Sep 11 18:03:24.901672 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:03:24.901641    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb5876dc_2022_4082_bbdc_777b4e452e58.slice/crio-4ed4fa2c1bf940cc9cfbc35d7db7139dae7ea226dd1d01467b43d77ce2be185f WatchSource:0}: Error finding container 4ed4fa2c1bf940cc9cfbc35d7db7139dae7ea226dd1d01467b43d77ce2be185f: Status 404 returned error can't find the container with id 4ed4fa2c1bf940cc9cfbc35d7db7139dae7ea226dd1d01467b43d77ce2be185f
Sep 11 18:03:25.352543 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:25.352498    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fb8c5d-gzqlh" event={"ID":"fb5876dc-2022-4082-bbdc-777b4e452e58","Type":"ContainerStarted","Data":"bf8f2898442f9481a82662b8e62daf45e9c0b2b3b679253ac8714d5b612a45e9"}
Sep 11 18:03:25.352730 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:25.352558    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fb8c5d-gzqlh" event={"ID":"fb5876dc-2022-4082-bbdc-777b4e452e58","Type":"ContainerStarted","Data":"4ed4fa2c1bf940cc9cfbc35d7db7139dae7ea226dd1d01467b43d77ce2be185f"}
Sep 11 18:03:25.393820 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:25.393077    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fb8c5d-gzqlh" podStartSLOduration=1.393046987 podStartE2EDuration="1.393046987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:03:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:03:25.388505026 +0000 UTC m=+1098.314456773" watchObservedRunningTime="2026-09-11 18:03:25.393046987 +0000 UTC m=+1098.318998734"
Sep 11 18:03:26.359839 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:26.359802    2579 generic.go:356] "Generic (PLEG): container finished" podID="fb5876dc-2022-4082-bbdc-777b4e452e58" containerID="bf8f2898442f9481a82662b8e62daf45e9c0b2b3b679253ac8714d5b612a45e9" exitCode=0
Sep 11 18:03:26.360214 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:26.359870    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fb8c5d-gzqlh" event={"ID":"fb5876dc-2022-4082-bbdc-777b4e452e58","Type":"ContainerDied","Data":"bf8f2898442f9481a82662b8e62daf45e9c0b2b3b679253ac8714d5b612a45e9"}
Sep 11 18:03:26.899178 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:26.899139    2579 patch_prober.go:28] interesting pod/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 18:03:26.899333 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:26.899203    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw" podUID="5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 18:03:27.367914 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.367882    2579 generic.go:356] "Generic (PLEG): container finished" podID="7995be1c-0190-4051-9fa8-f7e48250c792" containerID="1c3ea84ca1d0a63c20392a926e5c816c5022c9c02b2dd6fef94f9091e8b1d6f0" exitCode=0
Sep 11 18:03:27.368398 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.367950    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr" event={"ID":"7995be1c-0190-4051-9fa8-f7e48250c792","Type":"ContainerDied","Data":"1c3ea84ca1d0a63c20392a926e5c816c5022c9c02b2dd6fef94f9091e8b1d6f0"}
Sep 11 18:03:27.368398 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.368010    2579 scope.go:117] "RemoveContainer" containerID="abbae18014e17162e3521cf8df0a8a813b7a2dd2dfb4fc8374900ef7d5fade91"
Sep 11 18:03:27.500166 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.500140    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:03:27.539840 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.539814    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fb8c5d-gzqlh"
Sep 11 18:03:27.585753 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.585724    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7995be1c-0190-4051-9fa8-f7e48250c792-istiod-ca-cert\") pod \"7995be1c-0190-4051-9fa8-f7e48250c792\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") "
Sep 11 18:03:27.585956 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.585796    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7995be1c-0190-4051-9fa8-f7e48250c792-istio-podinfo\") pod \"7995be1c-0190-4051-9fa8-f7e48250c792\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") "
Sep 11 18:03:27.585956 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.585824    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb5876dc-2022-4082-bbdc-777b4e452e58-maas-api-service-ca\") pod \"fb5876dc-2022-4082-bbdc-777b4e452e58\" (UID: \"fb5876dc-2022-4082-bbdc-777b4e452e58\") "
Sep 11 18:03:27.585956 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.585845    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-istio-data\") pod \"7995be1c-0190-4051-9fa8-f7e48250c792\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") "
Sep 11 18:03:27.585956 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.585913    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-istio-envoy\") pod \"7995be1c-0190-4051-9fa8-f7e48250c792\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") "
Sep 11 18:03:27.585956 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.585933    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-credential-socket\") pod \"7995be1c-0190-4051-9fa8-f7e48250c792\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") "
Sep 11 18:03:27.586260 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.585961    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-workload-socket\") pod \"7995be1c-0190-4051-9fa8-f7e48250c792\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") "
Sep 11 18:03:27.586260 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.586005    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbdpn\" (UniqueName: \"kubernetes.io/projected/7995be1c-0190-4051-9fa8-f7e48250c792-kube-api-access-dbdpn\") pod \"7995be1c-0190-4051-9fa8-f7e48250c792\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") "
Sep 11 18:03:27.586260 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.586037    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-workload-certs\") pod \"7995be1c-0190-4051-9fa8-f7e48250c792\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") "
Sep 11 18:03:27.586260 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.586064    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7995be1c-0190-4051-9fa8-f7e48250c792-istio-token\") pod \"7995be1c-0190-4051-9fa8-f7e48250c792\" (UID: \"7995be1c-0190-4051-9fa8-f7e48250c792\") "
Sep 11 18:03:27.586475 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.586250    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb5876dc-2022-4082-bbdc-777b4e452e58-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fb5876dc-2022-4082-bbdc-777b4e452e58" (UID: "fb5876dc-2022-4082-bbdc-777b4e452e58"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:03:27.586475 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.586285    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7995be1c-0190-4051-9fa8-f7e48250c792-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7995be1c-0190-4051-9fa8-f7e48250c792" (UID: "7995be1c-0190-4051-9fa8-f7e48250c792"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:03:27.586475 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.586281    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7995be1c-0190-4051-9fa8-f7e48250c792" (UID: "7995be1c-0190-4051-9fa8-f7e48250c792"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:03:27.586632 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.586524    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb5876dc-2022-4082-bbdc-777b4e452e58-maas-api-service-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:27.586632 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.586543    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-workload-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:27.586632 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.586560    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7995be1c-0190-4051-9fa8-f7e48250c792-istiod-ca-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:27.586632 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.586552    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7995be1c-0190-4051-9fa8-f7e48250c792" (UID: "7995be1c-0190-4051-9fa8-f7e48250c792"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:03:27.586632 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.586611    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7995be1c-0190-4051-9fa8-f7e48250c792" (UID: "7995be1c-0190-4051-9fa8-f7e48250c792"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:03:27.586852 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.586701    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-istio-data" (OuterVolumeSpecName: "istio-data") pod "7995be1c-0190-4051-9fa8-f7e48250c792" (UID: "7995be1c-0190-4051-9fa8-f7e48250c792"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:03:27.588196 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.588174    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7995be1c-0190-4051-9fa8-f7e48250c792-istio-token" (OuterVolumeSpecName: "istio-token") pod "7995be1c-0190-4051-9fa8-f7e48250c792" (UID: "7995be1c-0190-4051-9fa8-f7e48250c792"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:03:27.588273 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.588195    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7995be1c-0190-4051-9fa8-f7e48250c792" (UID: "7995be1c-0190-4051-9fa8-f7e48250c792"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:03:27.588418 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.588401    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7995be1c-0190-4051-9fa8-f7e48250c792-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7995be1c-0190-4051-9fa8-f7e48250c792" (UID: "7995be1c-0190-4051-9fa8-f7e48250c792"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:03:27.588508 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.588491    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7995be1c-0190-4051-9fa8-f7e48250c792-kube-api-access-dbdpn" (OuterVolumeSpecName: "kube-api-access-dbdpn") pod "7995be1c-0190-4051-9fa8-f7e48250c792" (UID: "7995be1c-0190-4051-9fa8-f7e48250c792"). InnerVolumeSpecName "kube-api-access-dbdpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:03:27.687943 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.687903    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7995be1c-0190-4051-9fa8-f7e48250c792-istio-podinfo\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:27.687943 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.687935    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-istio-data\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:27.687943 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.687944    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-istio-envoy\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:27.687943 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.687952    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-credential-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:27.688209 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.687961    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbdpn\" (UniqueName: \"kubernetes.io/projected/7995be1c-0190-4051-9fa8-f7e48250c792-kube-api-access-dbdpn\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:27.688209 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.687969    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7995be1c-0190-4051-9fa8-f7e48250c792-workload-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:27.688209 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:27.687977    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7995be1c-0190-4051-9fa8-f7e48250c792-istio-token\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:28.375669 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:28.375635    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fb8c5d-gzqlh"
Sep 11 18:03:28.376119 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:28.375634    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fb8c5d-gzqlh" event={"ID":"fb5876dc-2022-4082-bbdc-777b4e452e58","Type":"ContainerDied","Data":"4ed4fa2c1bf940cc9cfbc35d7db7139dae7ea226dd1d01467b43d77ce2be185f"}
Sep 11 18:03:28.376119 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:28.375889    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ed4fa2c1bf940cc9cfbc35d7db7139dae7ea226dd1d01467b43d77ce2be185f"
Sep 11 18:03:28.377433 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:28.377395    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr" event={"ID":"7995be1c-0190-4051-9fa8-f7e48250c792","Type":"ContainerDied","Data":"ef1ed61053b5969c55c547c141d5281568b366f5e3313261ec743dea9b6451f9"}
Sep 11 18:03:28.377433 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:28.377420    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"
Sep 11 18:03:28.377626 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:28.377455    2579 scope.go:117] "RemoveContainer" containerID="1c3ea84ca1d0a63c20392a926e5c816c5022c9c02b2dd6fef94f9091e8b1d6f0"
Sep 11 18:03:28.419131 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:28.419094    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"]
Sep 11 18:03:28.423150 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:28.423124    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr"]
Sep 11 18:03:28.979384 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:28.979361    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 18:03:29.102003 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.101912    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-workload-certs\") pod \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") "
Sep 11 18:03:29.102003 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.101959    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtmrc\" (UniqueName: \"kubernetes.io/projected/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-kube-api-access-gtmrc\") pod \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") "
Sep 11 18:03:29.102003 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.101988    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-envoy\") pod \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") "
Sep 11 18:03:29.102286 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.102011    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-workload-socket\") pod \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") "
Sep 11 18:03:29.102286 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.102026    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-data\") pod \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") "
Sep 11 18:03:29.102286 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.102046    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-token\") pod \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") "
Sep 11 18:03:29.102286 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.102147    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-credential-socket\") pod \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") "
Sep 11 18:03:29.102286 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.102194    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" (UID: "5fdaf95b-34ff-4f64-a5c9-fc7e9083d372"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:03:29.102286 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.102280    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-podinfo\") pod \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") "
Sep 11 18:03:29.102583 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.102315    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istiod-ca-cert\") pod \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\" (UID: \"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372\") "
Sep 11 18:03:29.102583 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.102324    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" (UID: "5fdaf95b-34ff-4f64-a5c9-fc7e9083d372"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:03:29.102583 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.102367    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-data" (OuterVolumeSpecName: "istio-data") pod "5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" (UID: "5fdaf95b-34ff-4f64-a5c9-fc7e9083d372"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:03:29.102739 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.102636    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" (UID: "5fdaf95b-34ff-4f64-a5c9-fc7e9083d372"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:03:29.102739 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.102677    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-workload-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:29.102739 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.102700    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-data\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:29.102739 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.102714    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-workload-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:29.102955 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.102744    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" (UID: "5fdaf95b-34ff-4f64-a5c9-fc7e9083d372"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:03:29.104590 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.104541    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-token" (OuterVolumeSpecName: "istio-token") pod "5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" (UID: "5fdaf95b-34ff-4f64-a5c9-fc7e9083d372"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:03:29.104718 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.104608    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" (UID: "5fdaf95b-34ff-4f64-a5c9-fc7e9083d372"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:03:29.104834 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.104805    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-kube-api-access-gtmrc" (OuterVolumeSpecName: "kube-api-access-gtmrc") pod "5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" (UID: "5fdaf95b-34ff-4f64-a5c9-fc7e9083d372"). InnerVolumeSpecName "kube-api-access-gtmrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:03:29.104930 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.104917    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" (UID: "5fdaf95b-34ff-4f64-a5c9-fc7e9083d372"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:03:29.203658 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.203621    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-credential-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:29.203658 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.203653    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-podinfo\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:29.203658 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.203662    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istiod-ca-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:29.203918 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.203671    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtmrc\" (UniqueName: \"kubernetes.io/projected/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-kube-api-access-gtmrc\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:29.203918 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.203679    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-envoy\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:29.203918 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.203688    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372-istio-token\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:29.386700 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.386611    2579 generic.go:356] "Generic (PLEG): container finished" podID="5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" containerID="2865a713d7fc9f11f133c823c718a6c48957b82ca046cb9342bfbb2b78bcce3c" exitCode=0
Sep 11 18:03:29.386700 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.386658    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"
Sep 11 18:03:29.386700 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.386674    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw" event={"ID":"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372","Type":"ContainerDied","Data":"2865a713d7fc9f11f133c823c718a6c48957b82ca046cb9342bfbb2b78bcce3c"}
Sep 11 18:03:29.387286 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.386713    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw" event={"ID":"5fdaf95b-34ff-4f64-a5c9-fc7e9083d372","Type":"ContainerDied","Data":"c42d93926124488ba89c8c1e3170faa050471b32af6e3b7d259d2fec88a71366"}
Sep 11 18:03:29.387286 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.386734    2579 scope.go:117] "RemoveContainer" containerID="2865a713d7fc9f11f133c823c718a6c48957b82ca046cb9342bfbb2b78bcce3c"
Sep 11 18:03:29.396199 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.396179    2579 scope.go:117] "RemoveContainer" containerID="5459b8b59c5672cfcdc3fa6dfda11f812ce58423cec1f4e67d776019d4250858"
Sep 11 18:03:29.404372 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.404347    2579 scope.go:117] "RemoveContainer" containerID="2865a713d7fc9f11f133c823c718a6c48957b82ca046cb9342bfbb2b78bcce3c"
Sep 11 18:03:29.404630 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:03:29.404611    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2865a713d7fc9f11f133c823c718a6c48957b82ca046cb9342bfbb2b78bcce3c\": container with ID starting with 2865a713d7fc9f11f133c823c718a6c48957b82ca046cb9342bfbb2b78bcce3c not found: ID does not exist" containerID="2865a713d7fc9f11f133c823c718a6c48957b82ca046cb9342bfbb2b78bcce3c"
Sep 11 18:03:29.410827 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.404640    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2865a713d7fc9f11f133c823c718a6c48957b82ca046cb9342bfbb2b78bcce3c"} err="failed to get container status \"2865a713d7fc9f11f133c823c718a6c48957b82ca046cb9342bfbb2b78bcce3c\": rpc error: code = NotFound desc = could not find container \"2865a713d7fc9f11f133c823c718a6c48957b82ca046cb9342bfbb2b78bcce3c\": container with ID starting with 2865a713d7fc9f11f133c823c718a6c48957b82ca046cb9342bfbb2b78bcce3c not found: ID does not exist"
Sep 11 18:03:29.410827 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.405040    2579 scope.go:117] "RemoveContainer" containerID="5459b8b59c5672cfcdc3fa6dfda11f812ce58423cec1f4e67d776019d4250858"
Sep 11 18:03:29.411720 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:03:29.411558    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5459b8b59c5672cfcdc3fa6dfda11f812ce58423cec1f4e67d776019d4250858\": container with ID starting with 5459b8b59c5672cfcdc3fa6dfda11f812ce58423cec1f4e67d776019d4250858 not found: ID does not exist" containerID="5459b8b59c5672cfcdc3fa6dfda11f812ce58423cec1f4e67d776019d4250858"
Sep 11 18:03:29.411878 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.411734    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5459b8b59c5672cfcdc3fa6dfda11f812ce58423cec1f4e67d776019d4250858"} err="failed to get container status \"5459b8b59c5672cfcdc3fa6dfda11f812ce58423cec1f4e67d776019d4250858\": rpc error: code = NotFound desc = could not find container \"5459b8b59c5672cfcdc3fa6dfda11f812ce58423cec1f4e67d776019d4250858\": container with ID starting with 5459b8b59c5672cfcdc3fa6dfda11f812ce58423cec1f4e67d776019d4250858 not found: ID does not exist"
Sep 11 18:03:29.427032 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.427004    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"]
Sep 11 18:03:29.464816 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.464785    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw"]
Sep 11 18:03:29.535289 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.535248    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" path="/var/lib/kubelet/pods/5fdaf95b-34ff-4f64-a5c9-fc7e9083d372/volumes"
Sep 11 18:03:29.535832 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:29.535800    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7995be1c-0190-4051-9fa8-f7e48250c792" path="/var/lib/kubelet/pods/7995be1c-0190-4051-9fa8-f7e48250c792/volumes"
Sep 11 18:03:35.736705 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:35.736667    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fb8c5d-gzqlh"]
Sep 11 18:03:35.740639 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:35.740608    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fb8c5d-gzqlh"]
Sep 11 18:03:37.533922 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:37.533889    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb5876dc-2022-4082-bbdc-777b4e452e58" path="/var/lib/kubelet/pods/fb5876dc-2022-4082-bbdc-777b4e452e58/volumes"
Sep 11 18:03:40.667480 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.667441    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"]
Sep 11 18:03:40.667932 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.667916    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb5876dc-2022-4082-bbdc-777b4e452e58" containerName="revoke-keys"
Sep 11 18:03:40.667932 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.667933    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb5876dc-2022-4082-bbdc-777b4e452e58" containerName="revoke-keys"
Sep 11 18:03:40.668033 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.667951    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" containerName="istio-proxy"
Sep 11 18:03:40.668033 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.667957    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" containerName="istio-proxy"
Sep 11 18:03:40.668033 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.667963    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7995be1c-0190-4051-9fa8-f7e48250c792" containerName="istio-proxy"
Sep 11 18:03:40.668033 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.667969    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7995be1c-0190-4051-9fa8-f7e48250c792" containerName="istio-proxy"
Sep 11 18:03:40.668033 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.667984    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" containerName="istio-proxy"
Sep 11 18:03:40.668033 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.667990    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" containerName="istio-proxy"
Sep 11 18:03:40.668252 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.668043    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" containerName="istio-proxy"
Sep 11 18:03:40.668252 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.668051    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb5876dc-2022-4082-bbdc-777b4e452e58" containerName="revoke-keys"
Sep 11 18:03:40.668252 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.668059    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fdaf95b-34ff-4f64-a5c9-fc7e9083d372" containerName="istio-proxy"
Sep 11 18:03:40.668252 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.668069    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7995be1c-0190-4051-9fa8-f7e48250c792" containerName="istio-proxy"
Sep 11 18:03:40.668252 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.668075    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7995be1c-0190-4051-9fa8-f7e48250c792" containerName="istio-proxy"
Sep 11 18:03:40.670198 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.670182    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.673140 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:03:40.673104    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" is forbidden: User \"system:node:ip-10-0-140-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-211.ec2.internal' and this object" podUID="64907ac9-3935-4e9c-a5d7-52fffee5f300" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.673277 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:03:40.673150    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"e2e-shared-a-w2-fd32cd-openshift-default-dockercfg-qftvd\" is forbidden: User \"system:node:ip-10-0-140-211.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-211.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-fd32cd-openshift-default-dockercfg-qftvd\"" type="*v1.Secret"
Sep 11 18:03:40.704617 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.704580    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"]
Sep 11 18:03:40.820459 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.820403    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-envoy\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.820643 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.820478    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-credential-socket\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.820643 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.820519    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-workload-certs\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.820643 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.820543    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-podinfo\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.820643 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.820610    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64907ac9-3935-4e9c-a5d7-52fffee5f300-istiod-ca-cert\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.820896 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.820671    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-token\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.820896 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.820713    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-data\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.820896 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.820740    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-workload-socket\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.820896 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.820779    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcrxm\" (UniqueName: \"kubernetes.io/projected/64907ac9-3935-4e9c-a5d7-52fffee5f300-kube-api-access-dcrxm\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.922189 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.922086    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-envoy\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.922189 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.922147    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-credential-socket\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.922189 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.922169    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-workload-certs\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.922189 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.922188    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-podinfo\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.922529 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.922240    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64907ac9-3935-4e9c-a5d7-52fffee5f300-istiod-ca-cert\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.922529 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.922382    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-token\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.922529 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.922428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-data\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.922529 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.922460    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-workload-socket\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.922529 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.922489    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcrxm\" (UniqueName: \"kubernetes.io/projected/64907ac9-3935-4e9c-a5d7-52fffee5f300-kube-api-access-dcrxm\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.922810 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.922614    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-credential-socket\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.922810 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.922690    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-workload-certs\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.922957 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.922933    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-data\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.923054 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.923031    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64907ac9-3935-4e9c-a5d7-52fffee5f300-istiod-ca-cert\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.923151 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.923135    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-workload-socket\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.924552 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.924527    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-envoy\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.924772 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.924745    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-podinfo\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.945465 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.945439    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-token\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:40.950086 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:40.950067    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcrxm\" (UniqueName: \"kubernetes.io/projected/64907ac9-3935-4e9c-a5d7-52fffee5f300-kube-api-access-dcrxm\") pod \"e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") " pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:41.481979 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:41.481946    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-fd32cd-openshift-default-dockercfg-qftvd\""
Sep 11 18:03:41.491108 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:41.491067    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:41.793287 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:41.793261    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"]
Sep 11 18:03:41.795843 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:03:41.795815    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64907ac9_3935_4e9c_a5d7_52fffee5f300.slice/crio-393cccf7e0ba5c6e2bf96771c049069614ebb41417b0dafaad8fd392990d0fbb WatchSource:0}: Error finding container 393cccf7e0ba5c6e2bf96771c049069614ebb41417b0dafaad8fd392990d0fbb: Status 404 returned error can't find the container with id 393cccf7e0ba5c6e2bf96771c049069614ebb41417b0dafaad8fd392990d0fbb
Sep 11 18:03:41.798115 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:41.798082    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:03:41.798218 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:41.798167    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:03:41.798218 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:41.798211    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:03:42.465989 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:42.465946    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b" event={"ID":"64907ac9-3935-4e9c-a5d7-52fffee5f300","Type":"ContainerStarted","Data":"13662d212164c648ba97552e878108fe04283e397b1343daf6ff988a96502851"}
Sep 11 18:03:42.466181 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:42.466014    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b" event={"ID":"64907ac9-3935-4e9c-a5d7-52fffee5f300","Type":"ContainerStarted","Data":"393cccf7e0ba5c6e2bf96771c049069614ebb41417b0dafaad8fd392990d0fbb"}
Sep 11 18:03:42.491242 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:42.491216    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:42.496000 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:42.495973    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:42.520296 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:42.520240    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b" podStartSLOduration=2.520222737 podStartE2EDuration="2.520222737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:03:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:03:42.516346306 +0000 UTC m=+1115.442298053" watchObservedRunningTime="2026-09-11 18:03:42.520222737 +0000 UTC m=+1115.446174483"
Sep 11 18:03:43.472275 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:43.472245    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:43.473417 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:43.473388    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:03:45.513814 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:45.513778    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"]
Sep 11 18:03:45.514333 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:45.513992    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf" podUID="7bc96fce-f061-41fc-9631-5bc5dc8ec029" containerName="istio-proxy" containerID="cri-o://af4f48e29b2b14ab808aac0232ce308091cda9277957aac9edc75dec197a11bd" gracePeriod=30
Sep 11 18:03:46.514990 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.514956    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"]
Sep 11 18:03:46.515412 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.515399    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7995be1c-0190-4051-9fa8-f7e48250c792" containerName="istio-proxy"
Sep 11 18:03:46.515457 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.515413    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7995be1c-0190-4051-9fa8-f7e48250c792" containerName="istio-proxy"
Sep 11 18:03:46.518357 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.518336    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.521185 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.521164    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-386935-openshift-default-dockercfg-b6fb5\""
Sep 11 18:03:46.544222 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.544189    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"]
Sep 11 18:03:46.682175 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.682124    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-credential-socket\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.682175 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.682178    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/915d571b-b41a-4bb3-8b66-5424153832ad-istio-podinfo\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.682445 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.682357    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mssmg\" (UniqueName: \"kubernetes.io/projected/915d571b-b41a-4bb3-8b66-5424153832ad-kube-api-access-mssmg\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.682445 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.682395    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-istio-data\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.682445 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.682423    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/915d571b-b41a-4bb3-8b66-5424153832ad-istiod-ca-cert\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.682591 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.682457    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-workload-socket\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.682591 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.682481    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-workload-certs\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.682591 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.682500    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/915d571b-b41a-4bb3-8b66-5424153832ad-istio-token\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.682591 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.682544    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-istio-envoy\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.784163 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.784079    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-workload-certs\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.784163 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.784120    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/915d571b-b41a-4bb3-8b66-5424153832ad-istio-token\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.784163 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.784156    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-istio-envoy\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.784438 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.784215    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-credential-socket\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.784438 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.784233    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/915d571b-b41a-4bb3-8b66-5424153832ad-istio-podinfo\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.784438 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.784392    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mssmg\" (UniqueName: \"kubernetes.io/projected/915d571b-b41a-4bb3-8b66-5424153832ad-kube-api-access-mssmg\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.784438 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.784420    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-istio-data\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.784664 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.784440    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/915d571b-b41a-4bb3-8b66-5424153832ad-istiod-ca-cert\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.784664 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.784457    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-workload-socket\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.784664 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.784595    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-credential-socket\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.784664 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.784612    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-workload-certs\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.785103 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.785080    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-workload-socket\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.785236 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.785129    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-istio-data\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.785391 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.785359    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/915d571b-b41a-4bb3-8b66-5424153832ad-istiod-ca-cert\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.786791 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.786774    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-istio-envoy\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.787320 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.787290    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/915d571b-b41a-4bb3-8b66-5424153832ad-istio-podinfo\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.800234 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.800201    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/915d571b-b41a-4bb3-8b66-5424153832ad-istio-token\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.800388 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.800319    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mssmg\" (UniqueName: \"kubernetes.io/projected/915d571b-b41a-4bb3-8b66-5424153832ad-kube-api-access-mssmg\") pod \"e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") " pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:46.829283 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:46.829251    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:47.159800 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:47.159679    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"]
Sep 11 18:03:47.164313 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:03:47.164283    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod915d571b_b41a_4bb3_8b66_5424153832ad.slice/crio-cdebc5322ae5f0c2f9bb5a8b5455cd67841d0265202c4fad31ef1133b02a7b83 WatchSource:0}: Error finding container cdebc5322ae5f0c2f9bb5a8b5455cd67841d0265202c4fad31ef1133b02a7b83: Status 404 returned error can't find the container with id cdebc5322ae5f0c2f9bb5a8b5455cd67841d0265202c4fad31ef1133b02a7b83
Sep 11 18:03:47.166577 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:47.166539    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:03:47.166663 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:47.166625    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:03:47.166702 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:47.166692    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:03:47.508467 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:47.508431    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf" event={"ID":"915d571b-b41a-4bb3-8b66-5424153832ad","Type":"ContainerStarted","Data":"de1d174b6861c94ea50dbeb74218e5e34fbc771d587f48e90b78a28f83e90900"}
Sep 11 18:03:47.508624 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:47.508483    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf" event={"ID":"915d571b-b41a-4bb3-8b66-5424153832ad","Type":"ContainerStarted","Data":"cdebc5322ae5f0c2f9bb5a8b5455cd67841d0265202c4fad31ef1133b02a7b83"}
Sep 11 18:03:47.541734 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:47.541681    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf" podStartSLOduration=1.5416644879999999 podStartE2EDuration="1.541664488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:03:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:03:47.54019263 +0000 UTC m=+1120.466144389" watchObservedRunningTime="2026-09-11 18:03:47.541664488 +0000 UTC m=+1120.467616233"
Sep 11 18:03:47.829406 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:47.829304    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:48.835369 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:48.835340    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:49.520046 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:49.520013    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:49.521136 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:49.521118    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:03:50.161779 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.161714    2579 patch_prober.go:28] interesting pod/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 18:03:50.162142 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.161825    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf" podUID="7bc96fce-f061-41fc-9631-5bc5dc8ec029" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 18:03:50.775332 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.775267    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 18:03:50.929784 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.929728    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-workload-socket\") pod \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") "
Sep 11 18:03:50.929945 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.929805    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istiod-ca-cert\") pod \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") "
Sep 11 18:03:50.929945 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.929833    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-credential-socket\") pod \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") "
Sep 11 18:03:50.929945 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.929884    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-podinfo\") pod \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") "
Sep 11 18:03:50.929945 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.929922    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-token\") pod \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") "
Sep 11 18:03:50.930181 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.929959    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-data\") pod \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") "
Sep 11 18:03:50.930181 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.929980    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7bc96fce-f061-41fc-9631-5bc5dc8ec029" (UID: "7bc96fce-f061-41fc-9631-5bc5dc8ec029"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:03:50.930181 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.930016    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-envoy\") pod \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") "
Sep 11 18:03:50.930181 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.930051    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-workload-certs\") pod \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") "
Sep 11 18:03:50.930181 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.930105    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c76gg\" (UniqueName: \"kubernetes.io/projected/7bc96fce-f061-41fc-9631-5bc5dc8ec029-kube-api-access-c76gg\") pod \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\" (UID: \"7bc96fce-f061-41fc-9631-5bc5dc8ec029\") "
Sep 11 18:03:50.930181 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.930109    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7bc96fce-f061-41fc-9631-5bc5dc8ec029" (UID: "7bc96fce-f061-41fc-9631-5bc5dc8ec029"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:03:50.930181 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.930161    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-data" (OuterVolumeSpecName: "istio-data") pod "7bc96fce-f061-41fc-9631-5bc5dc8ec029" (UID: "7bc96fce-f061-41fc-9631-5bc5dc8ec029"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:03:50.930507 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.930187    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7bc96fce-f061-41fc-9631-5bc5dc8ec029" (UID: "7bc96fce-f061-41fc-9631-5bc5dc8ec029"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:03:50.930507 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.930311    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7bc96fce-f061-41fc-9631-5bc5dc8ec029" (UID: "7bc96fce-f061-41fc-9631-5bc5dc8ec029"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:03:50.930507 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.930476    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-data\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:50.930507 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.930494    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-workload-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:50.930507 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.930505    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-workload-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:50.930787 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.930513    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istiod-ca-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:50.930787 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.930522    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-credential-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:50.932188 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.932158    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-token" (OuterVolumeSpecName: "istio-token") pod "7bc96fce-f061-41fc-9631-5bc5dc8ec029" (UID: "7bc96fce-f061-41fc-9631-5bc5dc8ec029"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:03:50.932188 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.932158    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7bc96fce-f061-41fc-9631-5bc5dc8ec029" (UID: "7bc96fce-f061-41fc-9631-5bc5dc8ec029"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:03:50.932334 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.932214    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bc96fce-f061-41fc-9631-5bc5dc8ec029-kube-api-access-c76gg" (OuterVolumeSpecName: "kube-api-access-c76gg") pod "7bc96fce-f061-41fc-9631-5bc5dc8ec029" (UID: "7bc96fce-f061-41fc-9631-5bc5dc8ec029"). InnerVolumeSpecName "kube-api-access-c76gg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:03:50.932334 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:50.932247    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7bc96fce-f061-41fc-9631-5bc5dc8ec029" (UID: "7bc96fce-f061-41fc-9631-5bc5dc8ec029"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:03:51.031677 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:51.031589    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c76gg\" (UniqueName: \"kubernetes.io/projected/7bc96fce-f061-41fc-9631-5bc5dc8ec029-kube-api-access-c76gg\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:51.031677 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:51.031622    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-podinfo\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:51.031677 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:51.031631    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-token\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:51.031677 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:51.031642    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bc96fce-f061-41fc-9631-5bc5dc8ec029-istio-envoy\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:03:51.532877 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:51.532844    2579 generic.go:356] "Generic (PLEG): container finished" podID="7bc96fce-f061-41fc-9631-5bc5dc8ec029" containerID="af4f48e29b2b14ab808aac0232ce308091cda9277957aac9edc75dec197a11bd" exitCode=0
Sep 11 18:03:51.533266 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:51.533099    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"
Sep 11 18:03:51.534399 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:51.534374    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf" event={"ID":"7bc96fce-f061-41fc-9631-5bc5dc8ec029","Type":"ContainerDied","Data":"af4f48e29b2b14ab808aac0232ce308091cda9277957aac9edc75dec197a11bd"}
Sep 11 18:03:51.534454 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:51.534426    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf" event={"ID":"7bc96fce-f061-41fc-9631-5bc5dc8ec029","Type":"ContainerDied","Data":"24cce2ad0da959ec4b59e4e3cf014df01dc5dd240c8375aea197000cccb258c7"}
Sep 11 18:03:51.534498 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:51.534459    2579 scope.go:117] "RemoveContainer" containerID="af4f48e29b2b14ab808aac0232ce308091cda9277957aac9edc75dec197a11bd"
Sep 11 18:03:51.544236 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:51.544211    2579 scope.go:117] "RemoveContainer" containerID="f05ddab508d8df73566588f0c45709894c35cd272123389163d90c27be5c09d0"
Sep 11 18:03:51.552913 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:51.552896    2579 scope.go:117] "RemoveContainer" containerID="af4f48e29b2b14ab808aac0232ce308091cda9277957aac9edc75dec197a11bd"
Sep 11 18:03:51.553179 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:03:51.553161    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af4f48e29b2b14ab808aac0232ce308091cda9277957aac9edc75dec197a11bd\": container with ID starting with af4f48e29b2b14ab808aac0232ce308091cda9277957aac9edc75dec197a11bd not found: ID does not exist" containerID="af4f48e29b2b14ab808aac0232ce308091cda9277957aac9edc75dec197a11bd"
Sep 11 18:03:51.553226 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:51.553190    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af4f48e29b2b14ab808aac0232ce308091cda9277957aac9edc75dec197a11bd"} err="failed to get container status \"af4f48e29b2b14ab808aac0232ce308091cda9277957aac9edc75dec197a11bd\": rpc error: code = NotFound desc = could not find container \"af4f48e29b2b14ab808aac0232ce308091cda9277957aac9edc75dec197a11bd\": container with ID starting with af4f48e29b2b14ab808aac0232ce308091cda9277957aac9edc75dec197a11bd not found: ID does not exist"
Sep 11 18:03:51.553226 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:51.553206    2579 scope.go:117] "RemoveContainer" containerID="f05ddab508d8df73566588f0c45709894c35cd272123389163d90c27be5c09d0"
Sep 11 18:03:51.553441 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:03:51.553426    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f05ddab508d8df73566588f0c45709894c35cd272123389163d90c27be5c09d0\": container with ID starting with f05ddab508d8df73566588f0c45709894c35cd272123389163d90c27be5c09d0 not found: ID does not exist" containerID="f05ddab508d8df73566588f0c45709894c35cd272123389163d90c27be5c09d0"
Sep 11 18:03:51.553489 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:51.553445    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f05ddab508d8df73566588f0c45709894c35cd272123389163d90c27be5c09d0"} err="failed to get container status \"f05ddab508d8df73566588f0c45709894c35cd272123389163d90c27be5c09d0\": rpc error: code = NotFound desc = could not find container \"f05ddab508d8df73566588f0c45709894c35cd272123389163d90c27be5c09d0\": container with ID starting with f05ddab508d8df73566588f0c45709894c35cd272123389163d90c27be5c09d0 not found: ID does not exist"
Sep 11 18:03:51.561775 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:51.561736    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"]
Sep 11 18:03:51.567373 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:51.567345    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf"]
Sep 11 18:03:53.534465 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:53.534431    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bc96fce-f061-41fc-9631-5bc5dc8ec029" path="/var/lib/kubelet/pods/7bc96fce-f061-41fc-9631-5bc5dc8ec029/volumes"
Sep 11 18:03:59.513032 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:59.512984    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 18:03:59.513550 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:03:59.513082    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b" podUID="64907ac9-3935-4e9c-a5d7-52fffee5f300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 18:04:00.599927 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:00.599879    2579 generic.go:356] "Generic (PLEG): container finished" podID="64907ac9-3935-4e9c-a5d7-52fffee5f300" containerID="13662d212164c648ba97552e878108fe04283e397b1343daf6ff988a96502851" exitCode=0
Sep 11 18:04:00.600480 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:00.599976    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b" event={"ID":"64907ac9-3935-4e9c-a5d7-52fffee5f300","Type":"ContainerDied","Data":"13662d212164c648ba97552e878108fe04283e397b1343daf6ff988a96502851"}
Sep 11 18:04:00.600555 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:00.600517    2579 scope.go:117] "RemoveContainer" containerID="13662d212164c648ba97552e878108fe04283e397b1343daf6ff988a96502851"
Sep 11 18:04:00.602056 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:00.601990    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:04:00.602178 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:00.602103    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:04:00.602178 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:00.602151    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:04:01.611687 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:01.611638    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b" event={"ID":"64907ac9-3935-4e9c-a5d7-52fffee5f300","Type":"ContainerStarted","Data":"de4551d63542ff17aebd6d42b9c4913ed81f3d6ad872bf9747aea1ba830d6c8f"}
Sep 11 18:04:02.491938 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:02.491898    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:04:02.492329 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:02.492240    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 11 18:04:02.492509 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:02.492484    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b" podUID="64907ac9-3935-4e9c-a5d7-52fffee5f300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 11 18:04:03.492617 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:03.492575    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 11 18:04:03.493225 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:03.493186    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b" podUID="64907ac9-3935-4e9c-a5d7-52fffee5f300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 11 18:04:04.492947 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:04.492467    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 11 18:04:04.492947 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:04.492536    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b" podUID="64907ac9-3935-4e9c-a5d7-52fffee5f300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 11 18:04:05.492643 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:05.492595    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 11 18:04:05.492877 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:05.492666    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b" podUID="64907ac9-3935-4e9c-a5d7-52fffee5f300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 11 18:04:05.521299 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:05.521257    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 18:04:05.521801 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:05.521320    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf" podUID="915d571b-b41a-4bb3-8b66-5424153832ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 18:04:06.492609 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:06.492131    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 11 18:04:06.492609 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:06.492194    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b" podUID="64907ac9-3935-4e9c-a5d7-52fffee5f300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 11 18:04:07.495285 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:07.495251    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:04:07.495705 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:07.495524    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:04:07.496322 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:07.496299    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:04:07.654511 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:07.654481    2579 generic.go:356] "Generic (PLEG): container finished" podID="915d571b-b41a-4bb3-8b66-5424153832ad" containerID="de1d174b6861c94ea50dbeb74218e5e34fbc771d587f48e90b78a28f83e90900" exitCode=0
Sep 11 18:04:07.654621 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:07.654553    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf" event={"ID":"915d571b-b41a-4bb3-8b66-5424153832ad","Type":"ContainerDied","Data":"de1d174b6861c94ea50dbeb74218e5e34fbc771d587f48e90b78a28f83e90900"}
Sep 11 18:04:07.655016 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:07.655001    2579 scope.go:117] "RemoveContainer" containerID="de1d174b6861c94ea50dbeb74218e5e34fbc771d587f48e90b78a28f83e90900"
Sep 11 18:04:07.656026 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:07.655999    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:04:07.656168 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:07.656065    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:04:07.656168 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:07.656095    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:04:08.662434 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:08.662395    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf" event={"ID":"915d571b-b41a-4bb3-8b66-5424153832ad","Type":"ContainerStarted","Data":"cd1cf17d6a7629b2d2c45e412dd814ee588d3ae069fd0ffef46eb2d2b3b3f285"}
Sep 11 18:04:08.829913 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:08.829873    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:04:08.830201 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:08.830175    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 11 18:04:08.830280 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:08.830225    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf" podUID="915d571b-b41a-4bb3-8b66-5424153832ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 11 18:04:09.829936 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:09.829896    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 11 18:04:09.830343 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:09.829958    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf" podUID="915d571b-b41a-4bb3-8b66-5424153832ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 11 18:04:10.528651 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.528616    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"]
Sep 11 18:04:10.529076 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.529062    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bc96fce-f061-41fc-9631-5bc5dc8ec029" containerName="istio-proxy"
Sep 11 18:04:10.529128 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.529077    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bc96fce-f061-41fc-9631-5bc5dc8ec029" containerName="istio-proxy"
Sep 11 18:04:10.529167 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.529162    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bc96fce-f061-41fc-9631-5bc5dc8ec029" containerName="istio-proxy"
Sep 11 18:04:10.531232 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.531217    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.540361 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.540334    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-f95803-openshift-default-dockercfg-57nxh\""
Sep 11 18:04:10.559610 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.559582    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"]
Sep 11 18:04:10.638991 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.638948    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-envoy\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.638991 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.638995    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-data\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.639192 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.639013    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-token\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.639192 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.639145    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-workload-certs\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.639192 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.639184    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-credential-socket\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.639301 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.639212    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ef73d8e-4792-4f4e-973a-9362697ed49e-istiod-ca-cert\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.639301 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.639276    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr6j8\" (UniqueName: \"kubernetes.io/projected/9ef73d8e-4792-4f4e-973a-9362697ed49e-kube-api-access-nr6j8\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.639365 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.639333    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-podinfo\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.639403 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.639383    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-workload-socket\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.740522 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.740482    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-podinfo\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.740731 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.740542    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-workload-socket\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.740731 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.740570    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-envoy\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.740731 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.740590    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-data\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.740731 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.740608    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-token\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.740731 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.740657    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-workload-certs\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.741036 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.740858    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-credential-socket\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.741036 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.740969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ef73d8e-4792-4f4e-973a-9362697ed49e-istiod-ca-cert\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.741150 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.741076    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-workload-socket\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.741150 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.741101    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-data\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.741267 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.741152    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-workload-certs\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.741327 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.741289    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-credential-socket\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.741386 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.741364    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr6j8\" (UniqueName: \"kubernetes.io/projected/9ef73d8e-4792-4f4e-973a-9362697ed49e-kube-api-access-nr6j8\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.741632 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.741610    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ef73d8e-4792-4f4e-973a-9362697ed49e-istiod-ca-cert\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.742953 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.742931    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-envoy\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.743100 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.743081    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-podinfo\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.761886 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.761861    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-token\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.762034 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.761933    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr6j8\" (UniqueName: \"kubernetes.io/projected/9ef73d8e-4792-4f4e-973a-9362697ed49e-kube-api-access-nr6j8\") pod \"e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") " pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:10.830640 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.830558    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 11 18:04:10.830640 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.830613    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf" podUID="915d571b-b41a-4bb3-8b66-5424153832ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 11 18:04:10.841906 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:10.841874    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:11.156397 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:11.156373    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"]
Sep 11 18:04:11.158809 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:04:11.158780    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ef73d8e_4792_4f4e_973a_9362697ed49e.slice/crio-d12eef6cd2639fb14927fe55db5ef1f4c98ce6fd8e56d52bd7ed7c284f98fec9 WatchSource:0}: Error finding container d12eef6cd2639fb14927fe55db5ef1f4c98ce6fd8e56d52bd7ed7c284f98fec9: Status 404 returned error can't find the container with id d12eef6cd2639fb14927fe55db5ef1f4c98ce6fd8e56d52bd7ed7c284f98fec9
Sep 11 18:04:11.161122 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:11.161091    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:04:11.161236 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:11.161168    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:04:11.161236 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:11.161215    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:04:11.682525 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:11.682482    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9" event={"ID":"9ef73d8e-4792-4f4e-973a-9362697ed49e","Type":"ContainerStarted","Data":"ffd5c032158ad224cc6f6bec5918acafc2e6f6a0e31ff22c4d530120125edd78"}
Sep 11 18:04:11.682723 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:11.682542    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9" event={"ID":"9ef73d8e-4792-4f4e-973a-9362697ed49e","Type":"ContainerStarted","Data":"d12eef6cd2639fb14927fe55db5ef1f4c98ce6fd8e56d52bd7ed7c284f98fec9"}
Sep 11 18:04:11.722063 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:11.722005    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9" podStartSLOduration=1.721988547 podStartE2EDuration="1.721988547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:04:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:04:11.721548969 +0000 UTC m=+1144.647500714" watchObservedRunningTime="2026-09-11 18:04:11.721988547 +0000 UTC m=+1144.647940303"
Sep 11 18:04:11.830438 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:11.830404    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 11 18:04:11.830607 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:11.830461    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf" podUID="915d571b-b41a-4bb3-8b66-5424153832ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 11 18:04:11.842442 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:11.842395    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:12.830526 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:12.830489    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 11 18:04:12.830704 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:12.830546    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf" podUID="915d571b-b41a-4bb3-8b66-5424153832ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 11 18:04:12.847254 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:12.847225    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:13.699532 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:13.699464    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:13.709977 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:13.709936    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:13.829679 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:13.829643    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 11 18:04:13.829876 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:13.829713    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf" podUID="915d571b-b41a-4bb3-8b66-5424153832ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 11 18:04:14.833315 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:14.833283    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:04:14.833723 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:14.833544    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:04:14.834163 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:14.834149    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:04:15.669818 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.669785    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"]
Sep 11 18:04:15.670319 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.670305    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bc96fce-f061-41fc-9631-5bc5dc8ec029" containerName="istio-proxy"
Sep 11 18:04:15.670382 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.670321    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bc96fce-f061-41fc-9631-5bc5dc8ec029" containerName="istio-proxy"
Sep 11 18:04:15.670419 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.670396    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bc96fce-f061-41fc-9631-5bc5dc8ec029" containerName="istio-proxy"
Sep 11 18:04:15.672843 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.672825    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.697160 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.697127    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-3ebea5-openshift-default-dockercfg-k79jm\""
Sep 11 18:04:15.761749 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.761714    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"]
Sep 11 18:04:15.794102 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.794066    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-workload-socket\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.794289 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.794111    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7skl\" (UniqueName: \"kubernetes.io/projected/2a17563d-5f90-4655-a937-d8537a3805f5-kube-api-access-z7skl\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.794289 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.794147    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a17563d-5f90-4655-a937-d8537a3805f5-istio-podinfo\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.794289 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.794218    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a17563d-5f90-4655-a937-d8537a3805f5-istio-token\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.794289 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.794249    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-istio-data\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.794520 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.794289    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-istio-envoy\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.794567 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.794525    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-credential-socket\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.794606 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.794562    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a17563d-5f90-4655-a937-d8537a3805f5-istiod-ca-cert\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.794653 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.794611    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-workload-certs\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.895452 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.895410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-credential-socket\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.895452 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.895452    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a17563d-5f90-4655-a937-d8537a3805f5-istiod-ca-cert\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.896019 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.895476    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-workload-certs\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.896019 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.895526    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-workload-socket\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.896019 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.895546    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7skl\" (UniqueName: \"kubernetes.io/projected/2a17563d-5f90-4655-a937-d8537a3805f5-kube-api-access-z7skl\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.896019 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.895574    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a17563d-5f90-4655-a937-d8537a3805f5-istio-podinfo\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.896019 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.895619    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a17563d-5f90-4655-a937-d8537a3805f5-istio-token\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.896019 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.895652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-istio-data\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.896019 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.895679    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-istio-envoy\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.896019 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.895902    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-credential-socket\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.896019 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.895941    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-workload-socket\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.896510 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.896139    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-workload-certs\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.896510 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.896261    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-istio-data\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.896510 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.896448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a17563d-5f90-4655-a937-d8537a3805f5-istiod-ca-cert\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.897916 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.897892    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-istio-envoy\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.898117 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.898099    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a17563d-5f90-4655-a937-d8537a3805f5-istio-podinfo\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.929482 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.929415    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7skl\" (UniqueName: \"kubernetes.io/projected/2a17563d-5f90-4655-a937-d8537a3805f5-kube-api-access-z7skl\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.931425 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.931406    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a17563d-5f90-4655-a937-d8537a3805f5-istio-token\") pod \"e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") " pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:15.984673 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:15.984616    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:16.297526 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:16.297482    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"]
Sep 11 18:04:16.300032 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:04:16.300001    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a17563d_5f90_4655_a937_d8537a3805f5.slice/crio-579d0342fb9c336060c86e052bfb0b3ab7ae85721f7f20869f2afa27b89259b0 WatchSource:0}: Error finding container 579d0342fb9c336060c86e052bfb0b3ab7ae85721f7f20869f2afa27b89259b0: Status 404 returned error can't find the container with id 579d0342fb9c336060c86e052bfb0b3ab7ae85721f7f20869f2afa27b89259b0
Sep 11 18:04:16.302100 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:16.302066    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:04:16.302179 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:16.302135    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:04:16.302179 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:16.302161    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:04:16.718141 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:16.718045    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2" event={"ID":"2a17563d-5f90-4655-a937-d8537a3805f5","Type":"ContainerStarted","Data":"6dfee6ce373981017267fd5e33e6c8afb41d48e00ce9f86ddc2501e2d7cc68ae"}
Sep 11 18:04:16.718141 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:16.718107    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2" event={"ID":"2a17563d-5f90-4655-a937-d8537a3805f5","Type":"ContainerStarted","Data":"579d0342fb9c336060c86e052bfb0b3ab7ae85721f7f20869f2afa27b89259b0"}
Sep 11 18:04:16.758277 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:16.758220    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2" podStartSLOduration=1.758200118 podStartE2EDuration="1.758200118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:04:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:04:16.754730362 +0000 UTC m=+1149.680682107" watchObservedRunningTime="2026-09-11 18:04:16.758200118 +0000 UTC m=+1149.684151870"
Sep 11 18:04:16.985825 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:16.985660    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:17.990961 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:17.990928    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:18.729155 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:18.729125    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:18.730281 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:18.730261    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:32.820817 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:32.820776    2579 generic.go:356] "Generic (PLEG): container finished" podID="9ef73d8e-4792-4f4e-973a-9362697ed49e" containerID="ffd5c032158ad224cc6f6bec5918acafc2e6f6a0e31ff22c4d530120125edd78" exitCode=0
Sep 11 18:04:32.821227 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:32.820827    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9" event={"ID":"9ef73d8e-4792-4f4e-973a-9362697ed49e","Type":"ContainerDied","Data":"ffd5c032158ad224cc6f6bec5918acafc2e6f6a0e31ff22c4d530120125edd78"}
Sep 11 18:04:32.821271 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:32.821252    2579 scope.go:117] "RemoveContainer" containerID="ffd5c032158ad224cc6f6bec5918acafc2e6f6a0e31ff22c4d530120125edd78"
Sep 11 18:04:32.822419 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:32.822395    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:04:32.822483 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:32.822463    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:04:32.822522 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:32.822491    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:04:33.835183 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:33.835138    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9" event={"ID":"9ef73d8e-4792-4f4e-973a-9362697ed49e","Type":"ContainerStarted","Data":"7ac8d3a3f4c12d1ea2c9a0c7aa3a4aee0d4eda7b5fc1474b11d933345a5822ef"}
Sep 11 18:04:33.842860 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:33.842830    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:33.843089 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:33.843067    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 18:04:33.843136 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:33.843114    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9" podUID="9ef73d8e-4792-4f4e-973a-9362697ed49e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 18:04:34.843031 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:34.842992    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 18:04:34.843450 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:34.843057    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9" podUID="9ef73d8e-4792-4f4e-973a-9362697ed49e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 18:04:35.843256 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:35.843216    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 18:04:35.843655 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:35.843284    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9" podUID="9ef73d8e-4792-4f4e-973a-9362697ed49e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 18:04:36.842381 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:36.842343    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 18:04:36.842567 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:36.842398    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9" podUID="9ef73d8e-4792-4f4e-973a-9362697ed49e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 18:04:37.842447 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:37.842403    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 18:04:37.842990 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:37.842459    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9" podUID="9ef73d8e-4792-4f4e-973a-9362697ed49e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 18:04:38.843021 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:38.842980    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 18:04:38.843494 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:38.843053    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9" podUID="9ef73d8e-4792-4f4e-973a-9362697ed49e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 18:04:39.847671 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:39.847632    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:39.848205 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:39.848140    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:39.849040 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:39.849014    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:04:40.089955 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.089919    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"]
Sep 11 18:04:40.093453 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.093424    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.097651 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.097629    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-7e61be66-openshift-default-dockercfg-w9wt9\""
Sep 11 18:04:40.222063 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.222030    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"]
Sep 11 18:04:40.271630 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.271586    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-credential-socket\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.271881 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.271638    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-workload-socket\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.271881 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.271671    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-token\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.271881 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.271722    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-workload-certs\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.271881 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.271746    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-podinfo\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.271881 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.271803    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm5kw\" (UniqueName: \"kubernetes.io/projected/0d49960e-b625-488c-bbc4-dd20d7df1dcb-kube-api-access-bm5kw\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.271881 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.271829    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istiod-ca-cert\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.272173 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.271919    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-data\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.272173 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.271960    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-envoy\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.373103 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.373013    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-credential-socket\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.373103 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.373055    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-workload-socket\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.373345 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.373238    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-token\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.373345 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.373276    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-workload-certs\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.373345 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.373306    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-podinfo\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.373523 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.373496    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-credential-socket\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.373575 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.373504    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-workload-socket\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.373621 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.373581    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm5kw\" (UniqueName: \"kubernetes.io/projected/0d49960e-b625-488c-bbc4-dd20d7df1dcb-kube-api-access-bm5kw\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.373661 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.373621    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-workload-certs\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.373661 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.373628    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istiod-ca-cert\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.373747 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.373731    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-data\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.373847 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.373777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-envoy\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.374045 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.374025    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-data\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.374421 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.374397    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istiod-ca-cert\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.375770 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.375734    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-podinfo\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.375872 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.375791    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-envoy\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.383481 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.383459    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-token\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.385640 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.385615    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm5kw\" (UniqueName: \"kubernetes.io/projected/0d49960e-b625-488c-bbc4-dd20d7df1dcb-kube-api-access-bm5kw\") pod \"e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") " pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.405551 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.405521    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:40.696867 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.696834    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"]
Sep 11 18:04:40.698422 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:04:40.698396    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d49960e_b625_488c_bbc4_dd20d7df1dcb.slice/crio-5d28bf522099f9af299422e21ce1be1a5aaed8d53cc11eb895a25e51c6b4c1b0 WatchSource:0}: Error finding container 5d28bf522099f9af299422e21ce1be1a5aaed8d53cc11eb895a25e51c6b4c1b0: Status 404 returned error can't find the container with id 5d28bf522099f9af299422e21ce1be1a5aaed8d53cc11eb895a25e51c6b4c1b0
Sep 11 18:04:40.701470 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.701436    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:04:40.701565 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.701499    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:04:40.701565 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.701528    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:04:40.882272 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.882002    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps" event={"ID":"0d49960e-b625-488c-bbc4-dd20d7df1dcb","Type":"ContainerStarted","Data":"48a1055d1d8a2902bf0d726622550c39dabeb2432d42ca6b4ce31afcf57a6297"}
Sep 11 18:04:40.882272 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.882073    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps" event={"ID":"0d49960e-b625-488c-bbc4-dd20d7df1dcb","Type":"ContainerStarted","Data":"5d28bf522099f9af299422e21ce1be1a5aaed8d53cc11eb895a25e51c6b4c1b0"}
Sep 11 18:04:40.915961 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:40.915897    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps" podStartSLOduration=0.915874761 podStartE2EDuration="915.874761ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:04:40.912438223 +0000 UTC m=+1173.838389981" watchObservedRunningTime="2026-09-11 18:04:40.915874761 +0000 UTC m=+1173.841826529"
Sep 11 18:04:41.406559 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:41.406516    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:41.412558 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:41.412529    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:41.888090 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:41.888053    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:41.889467 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:41.888963    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:04:42.895664 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:42.895631    2579 generic.go:356] "Generic (PLEG): container finished" podID="2a17563d-5f90-4655-a937-d8537a3805f5" containerID="6dfee6ce373981017267fd5e33e6c8afb41d48e00ce9f86ddc2501e2d7cc68ae" exitCode=0
Sep 11 18:04:42.896068 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:42.895702    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2" event={"ID":"2a17563d-5f90-4655-a937-d8537a3805f5","Type":"ContainerDied","Data":"6dfee6ce373981017267fd5e33e6c8afb41d48e00ce9f86ddc2501e2d7cc68ae"}
Sep 11 18:04:42.896260 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:42.896242    2579 scope.go:117] "RemoveContainer" containerID="6dfee6ce373981017267fd5e33e6c8afb41d48e00ce9f86ddc2501e2d7cc68ae"
Sep 11 18:04:42.897417 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:42.897393    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:04:42.897472 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:42.897459    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:04:42.897508 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:42.897493    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:04:43.908638 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:43.908586    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2" event={"ID":"2a17563d-5f90-4655-a937-d8537a3805f5","Type":"ContainerStarted","Data":"4687b3f51a7e64e248f51ee42b541de80df3f79be2d48fd5153c455ece0085e5"}
Sep 11 18:04:43.985683 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:43.985642    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:43.986839 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:43.986800    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 11 18:04:43.987107 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:43.987074    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2" podUID="2a17563d-5f90-4655-a937-d8537a3805f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 11 18:04:44.986068 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:44.986033    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 11 18:04:44.986464 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:44.986099    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2" podUID="2a17563d-5f90-4655-a937-d8537a3805f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 11 18:04:45.985859 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:45.985818    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 11 18:04:45.986055 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:45.985891    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2" podUID="2a17563d-5f90-4655-a937-d8537a3805f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 11 18:04:46.985600 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:46.985556    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 11 18:04:46.986062 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:46.985633    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2" podUID="2a17563d-5f90-4655-a937-d8537a3805f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 11 18:04:47.985461 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:47.985426    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 11 18:04:47.985642 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:47.985498    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2" podUID="2a17563d-5f90-4655-a937-d8537a3805f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 11 18:04:48.729127 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:48.729089    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:48.901240 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:48.901180    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc"]
Sep 11 18:04:48.904882 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:48.904853    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc"
Sep 11 18:04:48.912078 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:48.912047    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-7e61be66-dockercfg-75d6h\""
Sep 11 18:04:48.912464 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:48.912234    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-7e61be66\""
Sep 11 18:04:48.945108 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:48.945073    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc"]
Sep 11 18:04:48.971776 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:48.971723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmhbv\" (UniqueName: \"kubernetes.io/projected/071e31d9-2bf5-4053-a179-e3d514a66997-kube-api-access-bmhbv\") pod \"payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc\" (UID: \"071e31d9-2bf5-4053-a179-e3d514a66997\") " pod="openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc"
Sep 11 18:04:48.971948 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:48.971843    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/071e31d9-2bf5-4053-a179-e3d514a66997-plugins-config-volume\") pod \"payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc\" (UID: \"071e31d9-2bf5-4053-a179-e3d514a66997\") " pod="openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc"
Sep 11 18:04:48.985624 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:48.985536    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 11 18:04:48.985624 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:48.985593    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2" podUID="2a17563d-5f90-4655-a937-d8537a3805f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 11 18:04:49.073263 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:49.073221    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/071e31d9-2bf5-4053-a179-e3d514a66997-plugins-config-volume\") pod \"payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc\" (UID: \"071e31d9-2bf5-4053-a179-e3d514a66997\") " pod="openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc"
Sep 11 18:04:49.073486 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:49.073419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmhbv\" (UniqueName: \"kubernetes.io/projected/071e31d9-2bf5-4053-a179-e3d514a66997-kube-api-access-bmhbv\") pod \"payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc\" (UID: \"071e31d9-2bf5-4053-a179-e3d514a66997\") " pod="openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc"
Sep 11 18:04:49.073990 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:49.073968    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/071e31d9-2bf5-4053-a179-e3d514a66997-plugins-config-volume\") pod \"payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc\" (UID: \"071e31d9-2bf5-4053-a179-e3d514a66997\") " pod="openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc"
Sep 11 18:04:49.092286 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:49.092247    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmhbv\" (UniqueName: \"kubernetes.io/projected/071e31d9-2bf5-4053-a179-e3d514a66997-kube-api-access-bmhbv\") pod \"payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc\" (UID: \"071e31d9-2bf5-4053-a179-e3d514a66997\") " pod="openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc"
Sep 11 18:04:49.224420 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:49.224373    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc"
Sep 11 18:04:49.504089 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:49.504058    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc"]
Sep 11 18:04:49.505345 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:04:49.505321    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod071e31d9_2bf5_4053_a179_e3d514a66997.slice/crio-d8b80d4cf38e3f442764111584800da8b658d715f2fa23344bdf0162179e3858 WatchSource:0}: Error finding container d8b80d4cf38e3f442764111584800da8b658d715f2fa23344bdf0162179e3858: Status 404 returned error can't find the container with id d8b80d4cf38e3f442764111584800da8b658d715f2fa23344bdf0162179e3858
Sep 11 18:04:49.950991 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:49.950891    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc" event={"ID":"071e31d9-2bf5-4053-a179-e3d514a66997","Type":"ContainerStarted","Data":"0a97fa6257d82559d18026687da14284d2b44b962ae29d3e68ac2d7eb49abd06"}
Sep 11 18:04:49.950991 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:49.950946    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc" event={"ID":"071e31d9-2bf5-4053-a179-e3d514a66997","Type":"ContainerStarted","Data":"d8b80d4cf38e3f442764111584800da8b658d715f2fa23344bdf0162179e3858"}
Sep 11 18:04:49.950991 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:49.950978    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc"
Sep 11 18:04:49.981998 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:49.981937    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc" podStartSLOduration=1.9819155990000001 podStartE2EDuration="1.981915599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:04:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:04:49.981887624 +0000 UTC m=+1182.907839371" watchObservedRunningTime="2026-09-11 18:04:49.981915599 +0000 UTC m=+1182.907867346"
Sep 11 18:04:49.989548 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:49.989516    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:04:49.990657 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:04:49.990637    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:05:00.959079 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:00.959046    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc"
Sep 11 18:05:04.055289 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:04.055255    2579 generic.go:356] "Generic (PLEG): container finished" podID="0d49960e-b625-488c-bbc4-dd20d7df1dcb" containerID="48a1055d1d8a2902bf0d726622550c39dabeb2432d42ca6b4ce31afcf57a6297" exitCode=0
Sep 11 18:05:04.055835 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:04.055328    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps" event={"ID":"0d49960e-b625-488c-bbc4-dd20d7df1dcb","Type":"ContainerDied","Data":"48a1055d1d8a2902bf0d726622550c39dabeb2432d42ca6b4ce31afcf57a6297"}
Sep 11 18:05:04.055913 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:04.055877    2579 scope.go:117] "RemoveContainer" containerID="48a1055d1d8a2902bf0d726622550c39dabeb2432d42ca6b4ce31afcf57a6297"
Sep 11 18:05:04.057081 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:04.057043    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:05:04.057177 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:04.057120    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:05:04.057216 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:04.057181    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:05:05.063851 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:05.063813    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps" event={"ID":"0d49960e-b625-488c-bbc4-dd20d7df1dcb","Type":"ContainerStarted","Data":"4fd30739816369f202e2ace31d477b2441cae6980bf84b28ae598e9a534e203f"}
Sep 11 18:05:05.406196 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:05.406101    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:05:05.406466 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:05.406316    2579 patch_prober.go:28] interesting pod/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 11 18:05:05.406650 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:05.406627    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps" podUID="0d49960e-b625-488c-bbc4-dd20d7df1dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 11 18:05:06.406260 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:06.406220    2579 patch_prober.go:28] interesting pod/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 11 18:05:06.406753 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:06.406287    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps" podUID="0d49960e-b625-488c-bbc4-dd20d7df1dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 11 18:05:07.406294 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:07.406250    2579 patch_prober.go:28] interesting pod/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 11 18:05:07.406907 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:07.406876    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps" podUID="0d49960e-b625-488c-bbc4-dd20d7df1dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 11 18:05:07.552223 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:07.552188    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-bbhjk_46c0eccf-9fc2-4fbf-ae39-3b1cf093b352/console-operator/1.log"
Sep 11 18:05:07.553983 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:07.553956    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-bbhjk_46c0eccf-9fc2-4fbf-ae39-3b1cf093b352/console-operator/1.log"
Sep 11 18:05:07.556096 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:07.556070    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zx6_cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd/ovn-acl-logging/0.log"
Sep 11 18:05:07.557535 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:07.557512    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zx6_cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd/ovn-acl-logging/0.log"
Sep 11 18:05:07.643043 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:07.643015    2579 scope.go:117] "RemoveContainer" containerID="d9faa57eee644ad905921a859318a6c55dc93b3b35b3f7d533247bd14a690785"
Sep 11 18:05:08.407045 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:08.406549    2579 patch_prober.go:28] interesting pod/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 11 18:05:08.407045 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:08.406611    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps" podUID="0d49960e-b625-488c-bbc4-dd20d7df1dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 11 18:05:09.407047 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:09.406997    2579 patch_prober.go:28] interesting pod/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 11 18:05:09.407571 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:09.407071    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps" podUID="0d49960e-b625-488c-bbc4-dd20d7df1dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 11 18:05:10.493921 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:10.493888    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:05:10.494377 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:10.494350    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:05:10.495196 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:05:10.495174    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:06:07.664491 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:07.664420    2579 scope.go:117] "RemoveContainer" containerID="2ebeb42ab0cd83f4fac9e79c94f3d9ea5b1b25aea8a2b71b29a21bb38425ec86"
Sep 11 18:06:07.673399 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:07.673366    2579 scope.go:117] "RemoveContainer" containerID="114e757e69776250b5e38b3060b09e113902b880da0340ddb22d0b949ead431a"
Sep 11 18:06:07.681925 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:07.681905    2579 scope.go:117] "RemoveContainer" containerID="9ebb0f5f06735c41e98aeb8ab04a0a9b0de7024e03049e96640e97867505c337"
Sep 11 18:06:07.689656 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:07.689637    2579 scope.go:117] "RemoveContainer" containerID="cff4e7919be33ea99aa0e4d858a18e5414de15d3f69dcf61ba8ee8449feb6885"
Sep 11 18:06:23.756835 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:23.756794    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e61be66-22nlq"]
Sep 11 18:06:23.760836 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:23.760811    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e61be66-22nlq"
Sep 11 18:06:23.763738 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:23.763714    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 18:06:23.763886 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:23.763843    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 18:06:23.780595 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:23.780573    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e61be66-22nlq"]
Sep 11 18:06:23.854901 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:23.854861    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ca60090-cd81-46e7-9f2c-45cb6f952290-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7e61be66-22nlq\" (UID: \"5ca60090-cd81-46e7-9f2c-45cb6f952290\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e61be66-22nlq"
Sep 11 18:06:23.956195 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:23.956158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ca60090-cd81-46e7-9f2c-45cb6f952290-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7e61be66-22nlq\" (UID: \"5ca60090-cd81-46e7-9f2c-45cb6f952290\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e61be66-22nlq"
Sep 11 18:06:23.956816 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:23.956797    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ca60090-cd81-46e7-9f2c-45cb6f952290-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7e61be66-22nlq\" (UID: \"5ca60090-cd81-46e7-9f2c-45cb6f952290\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e61be66-22nlq"
Sep 11 18:06:24.070781 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:24.070674    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e61be66-22nlq"
Sep 11 18:06:24.352049 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:24.351968    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e61be66-22nlq"]
Sep 11 18:06:24.357503 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:06:24.357473    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ca60090_cd81_46e7_9f2c_45cb6f952290.slice/crio-8e2f196244f4a931c5057cc8dfc0950ed2927deeb1159bfd94342c8ef96d97a7 WatchSource:0}: Error finding container 8e2f196244f4a931c5057cc8dfc0950ed2927deeb1159bfd94342c8ef96d97a7: Status 404 returned error can't find the container with id 8e2f196244f4a931c5057cc8dfc0950ed2927deeb1159bfd94342c8ef96d97a7
Sep 11 18:06:24.563441 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:24.563385    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e61be66-22nlq" event={"ID":"5ca60090-cd81-46e7-9f2c-45cb6f952290","Type":"ContainerStarted","Data":"8e2f196244f4a931c5057cc8dfc0950ed2927deeb1159bfd94342c8ef96d97a7"}
Sep 11 18:06:25.570033 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:25.570000    2579 generic.go:356] "Generic (PLEG): container finished" podID="5ca60090-cd81-46e7-9f2c-45cb6f952290" containerID="e0bd197dd2bdf21c83ab725b87d23f5f76d820f8f2568b6067b536dee55d0591" exitCode=0
Sep 11 18:06:25.570409 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:25.570077    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e61be66-22nlq" event={"ID":"5ca60090-cd81-46e7-9f2c-45cb6f952290","Type":"ContainerDied","Data":"e0bd197dd2bdf21c83ab725b87d23f5f76d820f8f2568b6067b536dee55d0591"}
Sep 11 18:06:26.714089 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:26.714066    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e61be66-22nlq"
Sep 11 18:06:26.891067 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:26.890986    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ca60090-cd81-46e7-9f2c-45cb6f952290-maas-api-service-ca\") pod \"5ca60090-cd81-46e7-9f2c-45cb6f952290\" (UID: \"5ca60090-cd81-46e7-9f2c-45cb6f952290\") "
Sep 11 18:06:26.891340 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:26.891316    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ca60090-cd81-46e7-9f2c-45cb6f952290-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5ca60090-cd81-46e7-9f2c-45cb6f952290" (UID: "5ca60090-cd81-46e7-9f2c-45cb6f952290"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:06:26.992198 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:26.992164    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ca60090-cd81-46e7-9f2c-45cb6f952290-maas-api-service-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:06:27.583181 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:27.583141    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e61be66-22nlq" event={"ID":"5ca60090-cd81-46e7-9f2c-45cb6f952290","Type":"ContainerDied","Data":"8e2f196244f4a931c5057cc8dfc0950ed2927deeb1159bfd94342c8ef96d97a7"}
Sep 11 18:06:27.583345 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:27.583193    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e2f196244f4a931c5057cc8dfc0950ed2927deeb1159bfd94342c8ef96d97a7"
Sep 11 18:06:27.583345 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:27.583154    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e61be66-22nlq"
Sep 11 18:06:39.801013 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:39.800970    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc"]
Sep 11 18:06:39.801525 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:39.801216    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc" podUID="071e31d9-2bf5-4053-a179-e3d514a66997" containerName="payload-processing" containerID="cri-o://0a97fa6257d82559d18026687da14284d2b44b962ae29d3e68ac2d7eb49abd06" gracePeriod=30
Sep 11 18:06:40.057720 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:40.057662    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc"
Sep 11 18:06:40.135734 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:40.135705    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmhbv\" (UniqueName: \"kubernetes.io/projected/071e31d9-2bf5-4053-a179-e3d514a66997-kube-api-access-bmhbv\") pod \"071e31d9-2bf5-4053-a179-e3d514a66997\" (UID: \"071e31d9-2bf5-4053-a179-e3d514a66997\") "
Sep 11 18:06:40.135918 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:40.135806    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/071e31d9-2bf5-4053-a179-e3d514a66997-plugins-config-volume\") pod \"071e31d9-2bf5-4053-a179-e3d514a66997\" (UID: \"071e31d9-2bf5-4053-a179-e3d514a66997\") "
Sep 11 18:06:40.136199 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:40.136176    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/071e31d9-2bf5-4053-a179-e3d514a66997-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "071e31d9-2bf5-4053-a179-e3d514a66997" (UID: "071e31d9-2bf5-4053-a179-e3d514a66997"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:06:40.137873 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:40.137844    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/071e31d9-2bf5-4053-a179-e3d514a66997-kube-api-access-bmhbv" (OuterVolumeSpecName: "kube-api-access-bmhbv") pod "071e31d9-2bf5-4053-a179-e3d514a66997" (UID: "071e31d9-2bf5-4053-a179-e3d514a66997"). InnerVolumeSpecName "kube-api-access-bmhbv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:06:40.146801 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:40.146775    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e61be66-22nlq"]
Sep 11 18:06:40.161421 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:40.161345    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e61be66-22nlq"]
Sep 11 18:06:40.236926 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:40.236884    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmhbv\" (UniqueName: \"kubernetes.io/projected/071e31d9-2bf5-4053-a179-e3d514a66997-kube-api-access-bmhbv\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:06:40.236926 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:40.236917    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/071e31d9-2bf5-4053-a179-e3d514a66997-plugins-config-volume\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:06:40.668632 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:40.668597    2579 generic.go:356] "Generic (PLEG): container finished" podID="071e31d9-2bf5-4053-a179-e3d514a66997" containerID="0a97fa6257d82559d18026687da14284d2b44b962ae29d3e68ac2d7eb49abd06" exitCode=0
Sep 11 18:06:40.668823 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:40.668641    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc"
Sep 11 18:06:40.668823 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:40.668687    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc" event={"ID":"071e31d9-2bf5-4053-a179-e3d514a66997","Type":"ContainerDied","Data":"0a97fa6257d82559d18026687da14284d2b44b962ae29d3e68ac2d7eb49abd06"}
Sep 11 18:06:40.668823 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:40.668739    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc" event={"ID":"071e31d9-2bf5-4053-a179-e3d514a66997","Type":"ContainerDied","Data":"d8b80d4cf38e3f442764111584800da8b658d715f2fa23344bdf0162179e3858"}
Sep 11 18:06:40.668823 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:40.668776    2579 scope.go:117] "RemoveContainer" containerID="0a97fa6257d82559d18026687da14284d2b44b962ae29d3e68ac2d7eb49abd06"
Sep 11 18:06:40.678171 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:40.678153    2579 scope.go:117] "RemoveContainer" containerID="0a97fa6257d82559d18026687da14284d2b44b962ae29d3e68ac2d7eb49abd06"
Sep 11 18:06:40.678436 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:06:40.678416    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a97fa6257d82559d18026687da14284d2b44b962ae29d3e68ac2d7eb49abd06\": container with ID starting with 0a97fa6257d82559d18026687da14284d2b44b962ae29d3e68ac2d7eb49abd06 not found: ID does not exist" containerID="0a97fa6257d82559d18026687da14284d2b44b962ae29d3e68ac2d7eb49abd06"
Sep 11 18:06:40.678513 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:40.678444    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a97fa6257d82559d18026687da14284d2b44b962ae29d3e68ac2d7eb49abd06"} err="failed to get container status \"0a97fa6257d82559d18026687da14284d2b44b962ae29d3e68ac2d7eb49abd06\": rpc error: code = NotFound desc = could not find container \"0a97fa6257d82559d18026687da14284d2b44b962ae29d3e68ac2d7eb49abd06\": container with ID starting with 0a97fa6257d82559d18026687da14284d2b44b962ae29d3e68ac2d7eb49abd06 not found: ID does not exist"
Sep 11 18:06:40.720510 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:40.720480    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc"]
Sep 11 18:06:40.728186 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:40.728160    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc"]
Sep 11 18:06:41.534338 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:41.534306    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="071e31d9-2bf5-4053-a179-e3d514a66997" path="/var/lib/kubelet/pods/071e31d9-2bf5-4053-a179-e3d514a66997/volumes"
Sep 11 18:06:41.534713 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:06:41.534674    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ca60090-cd81-46e7-9f2c-45cb6f952290" path="/var/lib/kubelet/pods/5ca60090-cd81-46e7-9f2c-45cb6f952290/volumes"
Sep 11 18:07:07.731167 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:07.731131    2579 scope.go:117] "RemoveContainer" containerID="1f8dfc171d01fb32494b337055354e410ef998daf047e40bac0cd6319eb9f5b0"
Sep 11 18:07:07.740176 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:07.740158    2579 scope.go:117] "RemoveContainer" containerID="395bd5708b416f2ee856a802a49f2396ea297a4134b2e0b012076f0cc76e5e50"
Sep 11 18:07:36.585853 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:36.585748    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"]
Sep 11 18:07:36.586384 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:36.585986    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps" podUID="0d49960e-b625-488c-bbc4-dd20d7df1dcb" containerName="istio-proxy" containerID="cri-o://4fd30739816369f202e2ace31d477b2441cae6980bf84b28ae598e9a534e203f" gracePeriod=30
Sep 11 18:07:40.497810 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:40.497776    2579 patch_prober.go:28] interesting pod/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 18:07:40.498274 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:40.497851    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps" podUID="0d49960e-b625-488c-bbc4-dd20d7df1dcb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 18:07:41.854824 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.852059    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:07:41.880936 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.880905    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-token\") pod \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") "
Sep 11 18:07:41.881119 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.880944    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-podinfo\") pod \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") "
Sep 11 18:07:41.881119 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.880966    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-data\") pod \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") "
Sep 11 18:07:41.881119 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.881013    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-credential-socket\") pod \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") "
Sep 11 18:07:41.881119 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.881050    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-workload-socket\") pod \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") "
Sep 11 18:07:41.881119 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.881093    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-envoy\") pod \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") "
Sep 11 18:07:41.881420 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.881150    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm5kw\" (UniqueName: \"kubernetes.io/projected/0d49960e-b625-488c-bbc4-dd20d7df1dcb-kube-api-access-bm5kw\") pod \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") "
Sep 11 18:07:41.881420 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.881197    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-workload-certs\") pod \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") "
Sep 11 18:07:41.881420 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.881228    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istiod-ca-cert\") pod \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\" (UID: \"0d49960e-b625-488c-bbc4-dd20d7df1dcb\") "
Sep 11 18:07:41.881420 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.881270    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0d49960e-b625-488c-bbc4-dd20d7df1dcb" (UID: "0d49960e-b625-488c-bbc4-dd20d7df1dcb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:07:41.881420 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.881282    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-data" (OuterVolumeSpecName: "istio-data") pod "0d49960e-b625-488c-bbc4-dd20d7df1dcb" (UID: "0d49960e-b625-488c-bbc4-dd20d7df1dcb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:07:41.881420 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.881332    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0d49960e-b625-488c-bbc4-dd20d7df1dcb" (UID: "0d49960e-b625-488c-bbc4-dd20d7df1dcb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:07:41.881736 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.881437    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0d49960e-b625-488c-bbc4-dd20d7df1dcb" (UID: "0d49960e-b625-488c-bbc4-dd20d7df1dcb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:07:41.881736 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.881589    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0d49960e-b625-488c-bbc4-dd20d7df1dcb" (UID: "0d49960e-b625-488c-bbc4-dd20d7df1dcb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:07:41.881736 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.881681    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-workload-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:07:41.881736 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.881702    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-workload-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:07:41.881736 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.881716    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istiod-ca-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:07:41.881736 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.881728    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-data\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:07:41.882083 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.881740    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-credential-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:07:41.883216 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.883186    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0d49960e-b625-488c-bbc4-dd20d7df1dcb" (UID: "0d49960e-b625-488c-bbc4-dd20d7df1dcb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:07:41.883323 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.883259    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0d49960e-b625-488c-bbc4-dd20d7df1dcb" (UID: "0d49960e-b625-488c-bbc4-dd20d7df1dcb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:07:41.883391 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.883370    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-token" (OuterVolumeSpecName: "istio-token") pod "0d49960e-b625-488c-bbc4-dd20d7df1dcb" (UID: "0d49960e-b625-488c-bbc4-dd20d7df1dcb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:07:41.883474 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.883456    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d49960e-b625-488c-bbc4-dd20d7df1dcb-kube-api-access-bm5kw" (OuterVolumeSpecName: "kube-api-access-bm5kw") pod "0d49960e-b625-488c-bbc4-dd20d7df1dcb" (UID: "0d49960e-b625-488c-bbc4-dd20d7df1dcb"). InnerVolumeSpecName "kube-api-access-bm5kw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:07:41.982906 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.982871    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-envoy\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:07:41.982906 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.982903    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm5kw\" (UniqueName: \"kubernetes.io/projected/0d49960e-b625-488c-bbc4-dd20d7df1dcb-kube-api-access-bm5kw\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:07:41.982906 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.982920    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-token\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:07:41.983163 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:41.982932    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d49960e-b625-488c-bbc4-dd20d7df1dcb-istio-podinfo\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:07:42.032198 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:42.032160    2579 generic.go:356] "Generic (PLEG): container finished" podID="0d49960e-b625-488c-bbc4-dd20d7df1dcb" containerID="4fd30739816369f202e2ace31d477b2441cae6980bf84b28ae598e9a534e203f" exitCode=0
Sep 11 18:07:42.032390 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:42.032204    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"
Sep 11 18:07:42.032390 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:42.032231    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps" event={"ID":"0d49960e-b625-488c-bbc4-dd20d7df1dcb","Type":"ContainerDied","Data":"4fd30739816369f202e2ace31d477b2441cae6980bf84b28ae598e9a534e203f"}
Sep 11 18:07:42.032390 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:42.032292    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps" event={"ID":"0d49960e-b625-488c-bbc4-dd20d7df1dcb","Type":"ContainerDied","Data":"5d28bf522099f9af299422e21ce1be1a5aaed8d53cc11eb895a25e51c6b4c1b0"}
Sep 11 18:07:42.032390 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:42.032317    2579 scope.go:117] "RemoveContainer" containerID="4fd30739816369f202e2ace31d477b2441cae6980bf84b28ae598e9a534e203f"
Sep 11 18:07:42.042654 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:42.042633    2579 scope.go:117] "RemoveContainer" containerID="48a1055d1d8a2902bf0d726622550c39dabeb2432d42ca6b4ce31afcf57a6297"
Sep 11 18:07:42.053063 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:42.053039    2579 scope.go:117] "RemoveContainer" containerID="4fd30739816369f202e2ace31d477b2441cae6980bf84b28ae598e9a534e203f"
Sep 11 18:07:42.053341 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:07:42.053319    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fd30739816369f202e2ace31d477b2441cae6980bf84b28ae598e9a534e203f\": container with ID starting with 4fd30739816369f202e2ace31d477b2441cae6980bf84b28ae598e9a534e203f not found: ID does not exist" containerID="4fd30739816369f202e2ace31d477b2441cae6980bf84b28ae598e9a534e203f"
Sep 11 18:07:42.053400 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:42.053352    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fd30739816369f202e2ace31d477b2441cae6980bf84b28ae598e9a534e203f"} err="failed to get container status \"4fd30739816369f202e2ace31d477b2441cae6980bf84b28ae598e9a534e203f\": rpc error: code = NotFound desc = could not find container \"4fd30739816369f202e2ace31d477b2441cae6980bf84b28ae598e9a534e203f\": container with ID starting with 4fd30739816369f202e2ace31d477b2441cae6980bf84b28ae598e9a534e203f not found: ID does not exist"
Sep 11 18:07:42.053400 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:42.053377    2579 scope.go:117] "RemoveContainer" containerID="48a1055d1d8a2902bf0d726622550c39dabeb2432d42ca6b4ce31afcf57a6297"
Sep 11 18:07:42.053695 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:07:42.053677    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48a1055d1d8a2902bf0d726622550c39dabeb2432d42ca6b4ce31afcf57a6297\": container with ID starting with 48a1055d1d8a2902bf0d726622550c39dabeb2432d42ca6b4ce31afcf57a6297 not found: ID does not exist" containerID="48a1055d1d8a2902bf0d726622550c39dabeb2432d42ca6b4ce31afcf57a6297"
Sep 11 18:07:42.053742 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:42.053700    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48a1055d1d8a2902bf0d726622550c39dabeb2432d42ca6b4ce31afcf57a6297"} err="failed to get container status \"48a1055d1d8a2902bf0d726622550c39dabeb2432d42ca6b4ce31afcf57a6297\": rpc error: code = NotFound desc = could not find container \"48a1055d1d8a2902bf0d726622550c39dabeb2432d42ca6b4ce31afcf57a6297\": container with ID starting with 48a1055d1d8a2902bf0d726622550c39dabeb2432d42ca6b4ce31afcf57a6297 not found: ID does not exist"
Sep 11 18:07:42.064184 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:42.064158    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"]
Sep 11 18:07:42.074279 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:42.074214    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps"]
Sep 11 18:07:43.537951 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:07:43.537919    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d49960e-b625-488c-bbc4-dd20d7df1dcb" path="/var/lib/kubelet/pods/0d49960e-b625-488c-bbc4-dd20d7df1dcb/volumes"
Sep 11 18:08:07.769062 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:07.769027    2579 scope.go:117] "RemoveContainer" containerID="8bfbf7e41f5f3c9b296e4abda7fef4b05745b41165490914772fbb16fbad8f22"
Sep 11 18:08:36.687651 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.687611    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"]
Sep 11 18:08:36.689504 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.689468    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ca60090-cd81-46e7-9f2c-45cb6f952290" containerName="revoke-keys"
Sep 11 18:08:36.689504 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.689504    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ca60090-cd81-46e7-9f2c-45cb6f952290" containerName="revoke-keys"
Sep 11 18:08:36.689703 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.689534    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="071e31d9-2bf5-4053-a179-e3d514a66997" containerName="payload-processing"
Sep 11 18:08:36.689703 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.689543    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="071e31d9-2bf5-4053-a179-e3d514a66997" containerName="payload-processing"
Sep 11 18:08:36.689703 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.689553    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d49960e-b625-488c-bbc4-dd20d7df1dcb" containerName="istio-proxy"
Sep 11 18:08:36.689703 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.689563    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d49960e-b625-488c-bbc4-dd20d7df1dcb" containerName="istio-proxy"
Sep 11 18:08:36.689703 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.689600    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d49960e-b625-488c-bbc4-dd20d7df1dcb" containerName="istio-proxy"
Sep 11 18:08:36.689703 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.689609    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d49960e-b625-488c-bbc4-dd20d7df1dcb" containerName="istio-proxy"
Sep 11 18:08:36.690014 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.689836    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="071e31d9-2bf5-4053-a179-e3d514a66997" containerName="payload-processing"
Sep 11 18:08:36.690014 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.689858    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ca60090-cd81-46e7-9f2c-45cb6f952290" containerName="revoke-keys"
Sep 11 18:08:36.690014 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.689868    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d49960e-b625-488c-bbc4-dd20d7df1dcb" containerName="istio-proxy"
Sep 11 18:08:36.690014 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.689886    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d49960e-b625-488c-bbc4-dd20d7df1dcb" containerName="istio-proxy"
Sep 11 18:08:36.694748 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.694715    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.699173 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.699152    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-6de04f-openshift-default-dockercfg-fj5xw\""
Sep 11 18:08:36.709529 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.709500    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"]
Sep 11 18:08:36.765752 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.765448    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-workload-certs\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.766216 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.766188    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-envoy\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.766601 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.766554    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghmjn\" (UniqueName: \"kubernetes.io/projected/c463d835-3f37-4db6-88c7-cfeee71aff33-kube-api-access-ghmjn\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.766878 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.766857    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-credential-socket\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.767087 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.767044    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-data\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.767249 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.767107    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c463d835-3f37-4db6-88c7-cfeee71aff33-istiod-ca-cert\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.767249 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.767140    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-podinfo\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.767249 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.767169    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-workload-socket\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.767507 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.767303    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-token\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.868268 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.868236    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-envoy\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.868457 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.868277    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghmjn\" (UniqueName: \"kubernetes.io/projected/c463d835-3f37-4db6-88c7-cfeee71aff33-kube-api-access-ghmjn\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.868457 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.868314    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-credential-socket\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.868457 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.868332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-data\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.868457 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.868359    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c463d835-3f37-4db6-88c7-cfeee71aff33-istiod-ca-cert\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.868457 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.868378    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-podinfo\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.868457 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.868396    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-workload-socket\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.868877 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.868475    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-token\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.868877 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.868508    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-workload-certs\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.868877 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.868801    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-credential-socket\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.869051 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.868918    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-data\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.869051 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.868978    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-workload-socket\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.869051 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.869003    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-workload-certs\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.869212 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.869166    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c463d835-3f37-4db6-88c7-cfeee71aff33-istiod-ca-cert\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.871022 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.871001    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-envoy\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.871338 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.871316    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-podinfo\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.879917 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.879894    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghmjn\" (UniqueName: \"kubernetes.io/projected/c463d835-3f37-4db6-88c7-cfeee71aff33-kube-api-access-ghmjn\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:36.879917 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:36.879906    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-token\") pod \"e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") " pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:37.005035 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:37.004993    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:37.293277 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:37.293250    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"]
Sep 11 18:08:37.295080 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:08:37.295045    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc463d835_3f37_4db6_88c7_cfeee71aff33.slice/crio-3362b731ea62fbd4e8e27969eb47daa2dd52934e4a000b5d676192639fe46f5a WatchSource:0}: Error finding container 3362b731ea62fbd4e8e27969eb47daa2dd52934e4a000b5d676192639fe46f5a: Status 404 returned error can't find the container with id 3362b731ea62fbd4e8e27969eb47daa2dd52934e4a000b5d676192639fe46f5a
Sep 11 18:08:37.297268 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:37.297237    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:08:37.297347 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:37.297301    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:08:37.297347 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:37.297330    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:08:37.374674 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:37.374631    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr" event={"ID":"c463d835-3f37-4db6-88c7-cfeee71aff33","Type":"ContainerStarted","Data":"adff30c9ae1a01b8ff9fb2922aa83ef6651c3776f95494fd9e61ae3e790b1df2"}
Sep 11 18:08:37.374864 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:37.374682    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr" event={"ID":"c463d835-3f37-4db6-88c7-cfeee71aff33","Type":"ContainerStarted","Data":"3362b731ea62fbd4e8e27969eb47daa2dd52934e4a000b5d676192639fe46f5a"}
Sep 11 18:08:37.404257 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:37.404194    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr" podStartSLOduration=1.404176931 podStartE2EDuration="1.404176931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:08:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:08:37.404133328 +0000 UTC m=+1410.330085073" watchObservedRunningTime="2026-09-11 18:08:37.404176931 +0000 UTC m=+1410.330128676"
Sep 11 18:08:38.005733 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:38.005693    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:38.011183 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:38.011158    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:38.380611 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:38.380517    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:08:38.381616 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:08:38.381588    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:09:03.541353 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:03.541320    2579 generic.go:356] "Generic (PLEG): container finished" podID="c463d835-3f37-4db6-88c7-cfeee71aff33" containerID="adff30c9ae1a01b8ff9fb2922aa83ef6651c3776f95494fd9e61ae3e790b1df2" exitCode=0
Sep 11 18:09:03.541806 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:03.541390    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr" event={"ID":"c463d835-3f37-4db6-88c7-cfeee71aff33","Type":"ContainerDied","Data":"adff30c9ae1a01b8ff9fb2922aa83ef6651c3776f95494fd9e61ae3e790b1df2"}
Sep 11 18:09:03.541861 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:03.541812    2579 scope.go:117] "RemoveContainer" containerID="adff30c9ae1a01b8ff9fb2922aa83ef6651c3776f95494fd9e61ae3e790b1df2"
Sep 11 18:09:03.542966 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:03.542942    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:09:03.543040 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:03.543009    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:09:03.543080 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:03.543041    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:09:04.555672 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:04.555630    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr" event={"ID":"c463d835-3f37-4db6-88c7-cfeee71aff33","Type":"ContainerStarted","Data":"717beea36d75c23dfd66585449f5e952efa1ce00ce556c3d327c1fff42fe438d"}
Sep 11 18:09:05.005386 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:05.005334    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:09:05.006436 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:05.006406    2579 patch_prober.go:28] interesting pod/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 11 18:09:05.006700 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:05.006648    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr" podUID="c463d835-3f37-4db6-88c7-cfeee71aff33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 11 18:09:06.006186 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:06.006134    2579 patch_prober.go:28] interesting pod/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 11 18:09:06.006696 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:06.006212    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr" podUID="c463d835-3f37-4db6-88c7-cfeee71aff33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 11 18:09:07.006218 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:07.006179    2579 patch_prober.go:28] interesting pod/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 11 18:09:07.007512 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:07.007139    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr" podUID="c463d835-3f37-4db6-88c7-cfeee71aff33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 11 18:09:07.797871 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:07.797832    2579 scope.go:117] "RemoveContainer" containerID="a032f4869084e598cd505e099cf09a554cb94b81457eee0a16bdff50cf33320e"
Sep 11 18:09:07.814434 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:07.814371    2579 scope.go:117] "RemoveContainer" containerID="9fdb243bd5e730909a63fe13973310e526cd4b200067a2c3a987720fc3c7450c"
Sep 11 18:09:08.005617 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:08.005574    2579 patch_prober.go:28] interesting pod/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 11 18:09:08.005829 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:08.005678    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr" podUID="c463d835-3f37-4db6-88c7-cfeee71aff33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 11 18:09:08.380597 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:08.380562    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:09:09.005931 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:09.005889    2579 patch_prober.go:28] interesting pod/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 11 18:09:09.006143 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:09.005953    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr" podUID="c463d835-3f37-4db6-88c7-cfeee71aff33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 11 18:09:10.009307 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:10.009277    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:09:10.010288 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:10.010269    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:09:11.045737 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.045704    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"]
Sep 11 18:09:11.048684 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.048662    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.059866 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.059844    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-f1705a-openshift-default-dockercfg-sdskh\""
Sep 11 18:09:11.142995 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.142951    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-workload-socket\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.142995 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.142994    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d772beb-1999-4a8f-b202-c68364690fce-istio-token\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.143204 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.143054    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-workload-certs\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.143204 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.143075    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-credential-socket\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.143204 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.143108    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d772beb-1999-4a8f-b202-c68364690fce-istio-podinfo\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.143204 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.143157    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgmmf\" (UniqueName: \"kubernetes.io/projected/0d772beb-1999-4a8f-b202-c68364690fce-kube-api-access-jgmmf\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.143343 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.143210    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-istio-data\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.143343 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.143295    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d772beb-1999-4a8f-b202-c68364690fce-istiod-ca-cert\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.143343 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.143326    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-istio-envoy\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.233627 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.233593    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"]
Sep 11 18:09:11.244101 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.244070    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d772beb-1999-4a8f-b202-c68364690fce-istiod-ca-cert\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.244267 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.244108    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-istio-envoy\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.244267 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.244143    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-workload-socket\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.244267 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.244170    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d772beb-1999-4a8f-b202-c68364690fce-istio-token\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.244267 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.244227    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-workload-certs\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.244267 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.244258    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-credential-socket\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.244538 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.244296    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d772beb-1999-4a8f-b202-c68364690fce-istio-podinfo\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.244538 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.244345    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgmmf\" (UniqueName: \"kubernetes.io/projected/0d772beb-1999-4a8f-b202-c68364690fce-kube-api-access-jgmmf\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.244538 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.244423    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-istio-data\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.244705 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.244650    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-workload-socket\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.244918 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.244879    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d772beb-1999-4a8f-b202-c68364690fce-istiod-ca-cert\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.245106 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.245086    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-credential-socket\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.245182 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.245160    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-istio-data\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.245231 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.245212    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-workload-certs\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.247012 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.246990    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-istio-envoy\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.247196 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.247177    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d772beb-1999-4a8f-b202-c68364690fce-istio-podinfo\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.269743 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.269708    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d772beb-1999-4a8f-b202-c68364690fce-istio-token\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.269919 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.269821    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgmmf\" (UniqueName: \"kubernetes.io/projected/0d772beb-1999-4a8f-b202-c68364690fce-kube-api-access-jgmmf\") pod \"e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") " pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.358949 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.358867    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:11.661959 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.661933    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"]
Sep 11 18:09:11.663892 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:09:11.663866    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d772beb_1999_4a8f_b202_c68364690fce.slice/crio-23c54c6935dab3ad4e6269b8e601b243fbb8da740a9d7cefd7c562346b5cc8c7 WatchSource:0}: Error finding container 23c54c6935dab3ad4e6269b8e601b243fbb8da740a9d7cefd7c562346b5cc8c7: Status 404 returned error can't find the container with id 23c54c6935dab3ad4e6269b8e601b243fbb8da740a9d7cefd7c562346b5cc8c7
Sep 11 18:09:11.666267 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.666237    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:09:11.666345 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.666299    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:09:11.666345 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:11.666326    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:09:12.602504 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:12.602465    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq" event={"ID":"0d772beb-1999-4a8f-b202-c68364690fce","Type":"ContainerStarted","Data":"c38b469d26c32ddc2947b37d03da515dc0d874e360876bbf6cb8afe0632a2457"}
Sep 11 18:09:12.602949 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:12.602519    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq" event={"ID":"0d772beb-1999-4a8f-b202-c68364690fce","Type":"ContainerStarted","Data":"23c54c6935dab3ad4e6269b8e601b243fbb8da740a9d7cefd7c562346b5cc8c7"}
Sep 11 18:09:12.643918 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:12.643869    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq" podStartSLOduration=2.643850197 podStartE2EDuration="2.643850197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:09:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:09:12.642337497 +0000 UTC m=+1445.568289243" watchObservedRunningTime="2026-09-11 18:09:12.643850197 +0000 UTC m=+1445.569801944"
Sep 11 18:09:13.359043 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:13.359011    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:13.364288 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:13.364263    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:13.608356 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:13.608321    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:13.609443 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:13.609393    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:34.638710 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:34.638678    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7865-46d971"]
Sep 11 18:09:34.641523 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:34.641504    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7865-46d971"
Sep 11 18:09:34.646931 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:34.646913    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nbc6p\""
Sep 11 18:09:34.659198 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:34.659170    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7865-46d971"]
Sep 11 18:09:34.811345 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:34.811309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc9s6\" (UniqueName: \"kubernetes.io/projected/31c9054f-00ee-4e1b-8d1c-f58aee63c9ce-kube-api-access-pc9s6\") pod \"test-curl-7865-46d971\" (UID: \"31c9054f-00ee-4e1b-8d1c-f58aee63c9ce\") " pod="opendatahub/test-curl-7865-46d971"
Sep 11 18:09:34.912708 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:34.912628    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc9s6\" (UniqueName: \"kubernetes.io/projected/31c9054f-00ee-4e1b-8d1c-f58aee63c9ce-kube-api-access-pc9s6\") pod \"test-curl-7865-46d971\" (UID: \"31c9054f-00ee-4e1b-8d1c-f58aee63c9ce\") " pod="opendatahub/test-curl-7865-46d971"
Sep 11 18:09:34.922511 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:34.922484    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc9s6\" (UniqueName: \"kubernetes.io/projected/31c9054f-00ee-4e1b-8d1c-f58aee63c9ce-kube-api-access-pc9s6\") pod \"test-curl-7865-46d971\" (UID: \"31c9054f-00ee-4e1b-8d1c-f58aee63c9ce\") " pod="opendatahub/test-curl-7865-46d971"
Sep 11 18:09:34.951385 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:34.951360    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7865-46d971"
Sep 11 18:09:35.228337 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:35.228309    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7865-46d971"]
Sep 11 18:09:35.230431 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:09:35.230399    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31c9054f_00ee_4e1b_8d1c_f58aee63c9ce.slice/crio-526127fe11eb5d3ab37810d453a7a249cc50e1df58351b142ce6f4c610d4b0ef WatchSource:0}: Error finding container 526127fe11eb5d3ab37810d453a7a249cc50e1df58351b142ce6f4c610d4b0ef: Status 404 returned error can't find the container with id 526127fe11eb5d3ab37810d453a7a249cc50e1df58351b142ce6f4c610d4b0ef
Sep 11 18:09:35.232321 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:35.232302    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 18:09:35.733306 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:35.733271    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7865-46d971" event={"ID":"31c9054f-00ee-4e1b-8d1c-f58aee63c9ce","Type":"ContainerStarted","Data":"526127fe11eb5d3ab37810d453a7a249cc50e1df58351b142ce6f4c610d4b0ef"}
Sep 11 18:09:36.739675 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:36.739641    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7865-46d971" event={"ID":"31c9054f-00ee-4e1b-8d1c-f58aee63c9ce","Type":"ContainerStarted","Data":"e77c2c76aeb17187eff91a5bf86b129afc7cc3ef1aff3a201965418fb510e79a"}
Sep 11 18:09:37.487060 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:37.486950    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7865-46d971" podStartSLOduration=2.955305967 podStartE2EDuration="3.486931385s" totalImagesPullingTime="531.625418ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:09:36.763523774 +0000 UTC m=+1469.689475521" watchObservedRunningTime="2026-09-11 18:09:37.486931385 +0000 UTC m=+1470.412883131"
Sep 11 18:09:37.487217 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:37.487180    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7865-46d971"]
Sep 11 18:09:37.498365 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:37.498333    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7865-46d971"]
Sep 11 18:09:37.634893 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:37.634850    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7865-c41706"]
Sep 11 18:09:37.635402 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:37.635381    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31c9054f-00ee-4e1b-8d1c-f58aee63c9ce" containerName="test-curl-7865-46d971"
Sep 11 18:09:37.635512 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:37.635404    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="31c9054f-00ee-4e1b-8d1c-f58aee63c9ce" containerName="test-curl-7865-46d971"
Sep 11 18:09:37.635512 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:37.635493    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="31c9054f-00ee-4e1b-8d1c-f58aee63c9ce" containerName="test-curl-7865-46d971"
Sep 11 18:09:37.637768 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:37.637741    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7865-c41706"
Sep 11 18:09:37.646448 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:37.646421    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvlxw\" (UniqueName: \"kubernetes.io/projected/4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a-kube-api-access-kvlxw\") pod \"test-curl-7865-c41706\" (UID: \"4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a\") " pod="opendatahub/test-curl-7865-c41706"
Sep 11 18:09:37.649868 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:37.649844    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7865-c41706"]
Sep 11 18:09:37.745934 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:09:37.745904    2579 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7865-46d971" container="test-curl-7865-46d971"
Sep 11 18:09:37.747886 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:37.747863    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvlxw\" (UniqueName: \"kubernetes.io/projected/4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a-kube-api-access-kvlxw\") pod \"test-curl-7865-c41706\" (UID: \"4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a\") " pod="opendatahub/test-curl-7865-c41706"
Sep 11 18:09:37.761554 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:37.761530    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvlxw\" (UniqueName: \"kubernetes.io/projected/4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a-kube-api-access-kvlxw\") pod \"test-curl-7865-c41706\" (UID: \"4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a\") " pod="opendatahub/test-curl-7865-c41706"
Sep 11 18:09:37.955694 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:37.955653    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7865-c41706"
Sep 11 18:09:38.239739 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:38.239693    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7865-c41706"]
Sep 11 18:09:38.242209 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:09:38.242181    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b1c759f_9cd8_4dc6_b2ff_1224eaeefe6a.slice/crio-32eb30f1d09e9029f11aa3ed749b3dffd497e0f8ea5556dd10d3cb40f3a5890d WatchSource:0}: Error finding container 32eb30f1d09e9029f11aa3ed749b3dffd497e0f8ea5556dd10d3cb40f3a5890d: Status 404 returned error can't find the container with id 32eb30f1d09e9029f11aa3ed749b3dffd497e0f8ea5556dd10d3cb40f3a5890d
Sep 11 18:09:38.753928 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:38.753886    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7865-c41706" event={"ID":"4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a","Type":"ContainerStarted","Data":"74ae8d65e8f79712759fb159379de819d94ea13a8d103dbf2e4567aeff97f831"}
Sep 11 18:09:38.754446 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:38.753936    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7865-c41706" event={"ID":"4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a","Type":"ContainerStarted","Data":"32eb30f1d09e9029f11aa3ed749b3dffd497e0f8ea5556dd10d3cb40f3a5890d"}
Sep 11 18:09:38.754446 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:38.753974    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7865-46d971" podUID="31c9054f-00ee-4e1b-8d1c-f58aee63c9ce" containerName="test-curl-7865-46d971" containerID="cri-o://e77c2c76aeb17187eff91a5bf86b129afc7cc3ef1aff3a201965418fb510e79a" gracePeriod=2
Sep 11 18:09:38.785295 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:38.785238    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7865-c41706" podStartSLOduration=1.78522113 podStartE2EDuration="1.78522113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:09:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:09:38.782876936 +0000 UTC m=+1471.708828682" watchObservedRunningTime="2026-09-11 18:09:38.78522113 +0000 UTC m=+1471.711172875"
Sep 11 18:09:39.526837 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:39.526713    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7865-c41706"]
Sep 11 18:09:39.537365 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:39.537328    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7865-c41706"]
Sep 11 18:09:39.759546 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:09:39.759514    2579 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7865-c41706" container="test-curl-7865-c41706"
Sep 11 18:09:40.766005 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:40.765940    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7865-c41706" podUID="4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a" containerName="test-curl-7865-c41706" containerID="cri-o://74ae8d65e8f79712759fb159379de819d94ea13a8d103dbf2e4567aeff97f831" gracePeriod=2
Sep 11 18:09:40.770937 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:09:40.770902    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7865-c41706\" is forbidden: User \"system:node:ip-10-0-140-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-211.ec2.internal' and this object" podUID="4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a" pod="opendatahub/test-curl-7865-c41706"
Sep 11 18:09:40.902980 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:40.902954    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7865-46d971"
Sep 11 18:09:40.905883 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:09:40.905853    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7865-c41706\" is forbidden: User \"system:node:ip-10-0-140-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-211.ec2.internal' and this object" podUID="4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a" pod="opendatahub/test-curl-7865-c41706"
Sep 11 18:09:40.982595 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:40.982560    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pc9s6\" (UniqueName: \"kubernetes.io/projected/31c9054f-00ee-4e1b-8d1c-f58aee63c9ce-kube-api-access-pc9s6\") pod \"31c9054f-00ee-4e1b-8d1c-f58aee63c9ce\" (UID: \"31c9054f-00ee-4e1b-8d1c-f58aee63c9ce\") "
Sep 11 18:09:40.984586 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:40.984560    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31c9054f-00ee-4e1b-8d1c-f58aee63c9ce-kube-api-access-pc9s6" (OuterVolumeSpecName: "kube-api-access-pc9s6") pod "31c9054f-00ee-4e1b-8d1c-f58aee63c9ce" (UID: "31c9054f-00ee-4e1b-8d1c-f58aee63c9ce"). InnerVolumeSpecName "kube-api-access-pc9s6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:09:41.084122 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:41.084037    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pc9s6\" (UniqueName: \"kubernetes.io/projected/31c9054f-00ee-4e1b-8d1c-f58aee63c9ce-kube-api-access-pc9s6\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:09:41.535018 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:41.534985    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31c9054f-00ee-4e1b-8d1c-f58aee63c9ce" path="/var/lib/kubelet/pods/31c9054f-00ee-4e1b-8d1c-f58aee63c9ce/volumes"
Sep 11 18:09:41.772672 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:41.772638    2579 generic.go:356] "Generic (PLEG): container finished" podID="31c9054f-00ee-4e1b-8d1c-f58aee63c9ce" containerID="e77c2c76aeb17187eff91a5bf86b129afc7cc3ef1aff3a201965418fb510e79a" exitCode=137
Sep 11 18:09:41.773135 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:41.772677    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7865-46d971"
Sep 11 18:09:41.773135 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:41.772737    2579 scope.go:117] "RemoveContainer" containerID="e77c2c76aeb17187eff91a5bf86b129afc7cc3ef1aff3a201965418fb510e79a"
Sep 11 18:09:41.781836 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:41.781813    2579 scope.go:117] "RemoveContainer" containerID="e77c2c76aeb17187eff91a5bf86b129afc7cc3ef1aff3a201965418fb510e79a"
Sep 11 18:09:41.782117 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:09:41.782096    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e77c2c76aeb17187eff91a5bf86b129afc7cc3ef1aff3a201965418fb510e79a\": container with ID starting with e77c2c76aeb17187eff91a5bf86b129afc7cc3ef1aff3a201965418fb510e79a not found: ID does not exist" containerID="e77c2c76aeb17187eff91a5bf86b129afc7cc3ef1aff3a201965418fb510e79a"
Sep 11 18:09:41.782174 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:41.782126    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e77c2c76aeb17187eff91a5bf86b129afc7cc3ef1aff3a201965418fb510e79a"} err="failed to get container status \"e77c2c76aeb17187eff91a5bf86b129afc7cc3ef1aff3a201965418fb510e79a\": rpc error: code = NotFound desc = could not find container \"e77c2c76aeb17187eff91a5bf86b129afc7cc3ef1aff3a201965418fb510e79a\": container with ID starting with e77c2c76aeb17187eff91a5bf86b129afc7cc3ef1aff3a201965418fb510e79a not found: ID does not exist"
Sep 11 18:09:43.020413 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:43.020347    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7865-c41706"
Sep 11 18:09:43.111158 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:43.111115    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvlxw\" (UniqueName: \"kubernetes.io/projected/4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a-kube-api-access-kvlxw\") pod \"4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a\" (UID: \"4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a\") "
Sep 11 18:09:43.113835 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:43.113800    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a-kube-api-access-kvlxw" (OuterVolumeSpecName: "kube-api-access-kvlxw") pod "4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a" (UID: "4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a"). InnerVolumeSpecName "kube-api-access-kvlxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:09:43.212816 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:43.212740    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvlxw\" (UniqueName: \"kubernetes.io/projected/4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a-kube-api-access-kvlxw\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:09:43.534513 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:43.534476    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a" path="/var/lib/kubelet/pods/4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a/volumes"
Sep 11 18:09:43.788202 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:43.787017    2579 generic.go:356] "Generic (PLEG): container finished" podID="4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a" containerID="74ae8d65e8f79712759fb159379de819d94ea13a8d103dbf2e4567aeff97f831" exitCode=137
Sep 11 18:09:43.788202 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:43.787218    2579 scope.go:117] "RemoveContainer" containerID="74ae8d65e8f79712759fb159379de819d94ea13a8d103dbf2e4567aeff97f831"
Sep 11 18:09:43.788202 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:43.787364    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7865-c41706"
Sep 11 18:09:43.806230 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:43.806200    2579 scope.go:117] "RemoveContainer" containerID="74ae8d65e8f79712759fb159379de819d94ea13a8d103dbf2e4567aeff97f831"
Sep 11 18:09:43.806673 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:09:43.806627    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74ae8d65e8f79712759fb159379de819d94ea13a8d103dbf2e4567aeff97f831\": container with ID starting with 74ae8d65e8f79712759fb159379de819d94ea13a8d103dbf2e4567aeff97f831 not found: ID does not exist" containerID="74ae8d65e8f79712759fb159379de819d94ea13a8d103dbf2e4567aeff97f831"
Sep 11 18:09:43.806797 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:43.806686    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74ae8d65e8f79712759fb159379de819d94ea13a8d103dbf2e4567aeff97f831"} err="failed to get container status \"74ae8d65e8f79712759fb159379de819d94ea13a8d103dbf2e4567aeff97f831\": rpc error: code = NotFound desc = could not find container \"74ae8d65e8f79712759fb159379de819d94ea13a8d103dbf2e4567aeff97f831\": container with ID starting with 74ae8d65e8f79712759fb159379de819d94ea13a8d103dbf2e4567aeff97f831 not found: ID does not exist"
Sep 11 18:09:48.482892 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:48.482809    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6de04f-vhvcv"]
Sep 11 18:09:48.483480 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:48.483457    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a" containerName="test-curl-7865-c41706"
Sep 11 18:09:48.483571 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:48.483483    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a" containerName="test-curl-7865-c41706"
Sep 11 18:09:48.483631 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:48.483614    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b1c759f-9cd8-4dc6-b2ff-1224eaeefe6a" containerName="test-curl-7865-c41706"
Sep 11 18:09:48.486412 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:48.486392    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6de04f-vhvcv"
Sep 11 18:09:48.489609 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:48.489582    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 18:09:48.489712 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:48.489619    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 18:09:48.503014 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:48.502987    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6de04f-vhvcv"]
Sep 11 18:09:48.567998 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:48.567958    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51cb2c21-5622-4336-b84f-1ac531630d4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-6de04f-vhvcv\" (UID: \"51cb2c21-5622-4336-b84f-1ac531630d4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6de04f-vhvcv"
Sep 11 18:09:48.669270 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:48.669229    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51cb2c21-5622-4336-b84f-1ac531630d4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-6de04f-vhvcv\" (UID: \"51cb2c21-5622-4336-b84f-1ac531630d4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6de04f-vhvcv"
Sep 11 18:09:48.669907 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:48.669884    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51cb2c21-5622-4336-b84f-1ac531630d4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-6de04f-vhvcv\" (UID: \"51cb2c21-5622-4336-b84f-1ac531630d4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6de04f-vhvcv"
Sep 11 18:09:48.797791 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:48.797735    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6de04f-vhvcv"
Sep 11 18:09:49.107531 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:49.107445    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6de04f-vhvcv"]
Sep 11 18:09:49.114702 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:09:49.114672    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51cb2c21_5622_4336_b84f_1ac531630d4c.slice/crio-96c0899d6cfd6ff5e73186ed41aa3f0d6f1a8db0414665e77997ccb3b166bf74 WatchSource:0}: Error finding container 96c0899d6cfd6ff5e73186ed41aa3f0d6f1a8db0414665e77997ccb3b166bf74: Status 404 returned error can't find the container with id 96c0899d6cfd6ff5e73186ed41aa3f0d6f1a8db0414665e77997ccb3b166bf74
Sep 11 18:09:49.842660 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:49.842625    2579 generic.go:356] "Generic (PLEG): container finished" podID="51cb2c21-5622-4336-b84f-1ac531630d4c" containerID="b0fa55abff983e46b9d049f5d3303b7a825a5417097bb414923a0c6004ceeab4" exitCode=0
Sep 11 18:09:49.843107 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:49.842708    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6de04f-vhvcv" event={"ID":"51cb2c21-5622-4336-b84f-1ac531630d4c","Type":"ContainerDied","Data":"b0fa55abff983e46b9d049f5d3303b7a825a5417097bb414923a0c6004ceeab4"}
Sep 11 18:09:49.843107 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:49.842772    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6de04f-vhvcv" event={"ID":"51cb2c21-5622-4336-b84f-1ac531630d4c","Type":"ContainerStarted","Data":"96c0899d6cfd6ff5e73186ed41aa3f0d6f1a8db0414665e77997ccb3b166bf74"}
Sep 11 18:09:50.994140 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:50.994117    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6de04f-vhvcv"
Sep 11 18:09:51.096906 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:51.096818    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51cb2c21-5622-4336-b84f-1ac531630d4c-maas-api-service-ca\") pod \"51cb2c21-5622-4336-b84f-1ac531630d4c\" (UID: \"51cb2c21-5622-4336-b84f-1ac531630d4c\") "
Sep 11 18:09:51.097195 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:51.097172    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51cb2c21-5622-4336-b84f-1ac531630d4c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "51cb2c21-5622-4336-b84f-1ac531630d4c" (UID: "51cb2c21-5622-4336-b84f-1ac531630d4c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:09:51.197956 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:51.197909    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51cb2c21-5622-4336-b84f-1ac531630d4c-maas-api-service-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:09:51.856047 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:51.856015    2579 generic.go:356] "Generic (PLEG): container finished" podID="0d772beb-1999-4a8f-b202-c68364690fce" containerID="c38b469d26c32ddc2947b37d03da515dc0d874e360876bbf6cb8afe0632a2457" exitCode=0
Sep 11 18:09:51.856261 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:51.856088    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq" event={"ID":"0d772beb-1999-4a8f-b202-c68364690fce","Type":"ContainerDied","Data":"c38b469d26c32ddc2947b37d03da515dc0d874e360876bbf6cb8afe0632a2457"}
Sep 11 18:09:51.856594 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:51.856577    2579 scope.go:117] "RemoveContainer" containerID="c38b469d26c32ddc2947b37d03da515dc0d874e360876bbf6cb8afe0632a2457"
Sep 11 18:09:51.857428 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:51.857409    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6de04f-vhvcv" event={"ID":"51cb2c21-5622-4336-b84f-1ac531630d4c","Type":"ContainerDied","Data":"96c0899d6cfd6ff5e73186ed41aa3f0d6f1a8db0414665e77997ccb3b166bf74"}
Sep 11 18:09:51.857501 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:51.857444    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96c0899d6cfd6ff5e73186ed41aa3f0d6f1a8db0414665e77997ccb3b166bf74"
Sep 11 18:09:51.857501 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:51.857449    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6de04f-vhvcv"
Sep 11 18:09:51.857862 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:51.857820    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:09:51.857994 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:51.857888    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:09:51.857994 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:51.857931    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:09:52.865997 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:52.865960    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq" event={"ID":"0d772beb-1999-4a8f-b202-c68364690fce","Type":"ContainerStarted","Data":"d9bc2257aea30b96c582a2af4a1be8de9600993e600cb2a385eab2f197003632"}
Sep 11 18:09:53.359092 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:53.359062    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:53.359270 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:53.359255    2579 patch_prober.go:28] interesting pod/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 11 18:09:53.359320 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:53.359299    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq" podUID="0d772beb-1999-4a8f-b202-c68364690fce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 11 18:09:54.360126 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:54.360088    2579 patch_prober.go:28] interesting pod/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 11 18:09:54.360509 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:54.360149    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq" podUID="0d772beb-1999-4a8f-b202-c68364690fce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 11 18:09:55.359608 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:55.359568    2579 patch_prober.go:28] interesting pod/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 11 18:09:55.359864 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:55.359629    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq" podUID="0d772beb-1999-4a8f-b202-c68364690fce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 11 18:09:56.359860 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:56.359825    2579 patch_prober.go:28] interesting pod/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 11 18:09:56.360259 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:56.359881    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq" podUID="0d772beb-1999-4a8f-b202-c68364690fce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 11 18:09:57.359310 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:57.359270    2579 patch_prober.go:28] interesting pod/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 11 18:09:57.359490 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:57.359361    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq" podUID="0d772beb-1999-4a8f-b202-c68364690fce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 11 18:09:58.363989 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:58.363957    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:58.364372 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:58.364350    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:09:58.365140 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:09:58.365120    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:10:04.993458 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:04.993426    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6de04f-vhvcv"]
Sep 11 18:10:05.018522 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:05.018486    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6de04f-vhvcv"]
Sep 11 18:10:05.535797 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:05.535743    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51cb2c21-5622-4336-b84f-1ac531630d4c" path="/var/lib/kubelet/pods/51cb2c21-5622-4336-b84f-1ac531630d4c/volumes"
Sep 11 18:10:07.591697 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:07.591660    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-bbhjk_46c0eccf-9fc2-4fbf-ae39-3b1cf093b352/console-operator/1.log"
Sep 11 18:10:07.595326 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:07.595301    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-bbhjk_46c0eccf-9fc2-4fbf-ae39-3b1cf093b352/console-operator/1.log"
Sep 11 18:10:07.597033 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:07.597012    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zx6_cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd/ovn-acl-logging/0.log"
Sep 11 18:10:07.600151 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:07.600134    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zx6_cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd/ovn-acl-logging/0.log"
Sep 11 18:10:07.839266 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:07.839230    2579 scope.go:117] "RemoveContainer" containerID="bf8f2898442f9481a82662b8e62daf45e9c0b2b3b679253ac8714d5b612a45e9"
Sep 11 18:10:13.290793 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:13.290742    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"]
Sep 11 18:10:13.291209 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:13.290977    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr" podUID="c463d835-3f37-4db6-88c7-cfeee71aff33" containerName="istio-proxy" containerID="cri-o://717beea36d75c23dfd66585449f5e952efa1ce00ce556c3d327c1fff42fe438d" gracePeriod=30
Sep 11 18:10:13.719933 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:13.719854    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v"]
Sep 11 18:10:13.720346 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:13.720332    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51cb2c21-5622-4336-b84f-1ac531630d4c" containerName="revoke-keys"
Sep 11 18:10:13.720392 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:13.720347    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="51cb2c21-5622-4336-b84f-1ac531630d4c" containerName="revoke-keys"
Sep 11 18:10:13.720448 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:13.720439    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="51cb2c21-5622-4336-b84f-1ac531630d4c" containerName="revoke-keys"
Sep 11 18:10:13.722622 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:13.722603    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v"
Sep 11 18:10:13.727565 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:10:13.727530    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v\" is forbidden: User \"system:node:ip-10-0-140-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-140-211.ec2.internal' and this object" podUID="bb2c195c-a1f3-47c7-857b-27f307adeba8" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v"
Sep 11 18:10:13.727713 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:10:13.727600    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-211.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-140-211.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 11 18:10:13.727713 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:10:13.727600    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-api-cleanup-dockercfg-4wxpj\" is forbidden: User \"system:node:ip-10-0-140-211.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-140-211.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\"" type="*v1.Secret"
Sep 11 18:10:13.745726 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:13.745699    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb2c195c-a1f3-47c7-857b-27f307adeba8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v\" (UID: \"bb2c195c-a1f3-47c7-857b-27f307adeba8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v"
Sep 11 18:10:13.755370 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:13.755345    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v"]
Sep 11 18:10:13.846917 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:13.846876    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb2c195c-a1f3-47c7-857b-27f307adeba8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v\" (UID: \"bb2c195c-a1f3-47c7-857b-27f307adeba8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v"
Sep 11 18:10:14.762232 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:14.762193    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 18:10:14.848124 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:10:14.848088    2579 configmap.go:193] Couldn't get configMap odh-ai-gateway-infra/openshift-service-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Sep 11 18:10:14.848292 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:10:14.848177    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb2c195c-a1f3-47c7-857b-27f307adeba8-maas-api-service-ca podName:bb2c195c-a1f3-47c7-857b-27f307adeba8 nodeName:}" failed. No retries permitted until 2026-09-11 18:10:15.348157523 +0000 UTC m=+1508.274109253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-service-ca" (UniqueName: "kubernetes.io/configmap/bb2c195c-a1f3-47c7-857b-27f307adeba8-maas-api-service-ca") pod "maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v" (UID: "bb2c195c-a1f3-47c7-857b-27f307adeba8") : failed to sync configmap cache: timed out waiting for the condition
Sep 11 18:10:14.997818 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:14.997752    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 18:10:15.363573 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:15.363534    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb2c195c-a1f3-47c7-857b-27f307adeba8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v\" (UID: \"bb2c195c-a1f3-47c7-857b-27f307adeba8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v"
Sep 11 18:10:15.364243 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:15.364223    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb2c195c-a1f3-47c7-857b-27f307adeba8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v\" (UID: \"bb2c195c-a1f3-47c7-857b-27f307adeba8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v"
Sep 11 18:10:15.532730 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:15.532697    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v"
Sep 11 18:10:15.829982 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:15.829854    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v"]
Sep 11 18:10:15.832914 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:10:15.832881    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb2c195c_a1f3_47c7_857b_27f307adeba8.slice/crio-db8f20ffed3af0243eaff57b69e8a60f0a79a7f5819977380e2d5b9815b3a110 WatchSource:0}: Error finding container db8f20ffed3af0243eaff57b69e8a60f0a79a7f5819977380e2d5b9815b3a110: Status 404 returned error can't find the container with id db8f20ffed3af0243eaff57b69e8a60f0a79a7f5819977380e2d5b9815b3a110
Sep 11 18:10:16.018798 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:16.018748    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v" event={"ID":"bb2c195c-a1f3-47c7-857b-27f307adeba8","Type":"ContainerStarted","Data":"db8f20ffed3af0243eaff57b69e8a60f0a79a7f5819977380e2d5b9815b3a110"}
Sep 11 18:10:17.026433 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:17.026396    2579 generic.go:356] "Generic (PLEG): container finished" podID="bb2c195c-a1f3-47c7-857b-27f307adeba8" containerID="09fb58ad2d60dd0b9ea0b5327bb9924ac533c56e7fd2d340c84b471da4051507" exitCode=0
Sep 11 18:10:17.026907 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:17.026483    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v" event={"ID":"bb2c195c-a1f3-47c7-857b-27f307adeba8","Type":"ContainerDied","Data":"09fb58ad2d60dd0b9ea0b5327bb9924ac533c56e7fd2d340c84b471da4051507"}
Sep 11 18:10:18.168619 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.168593    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v"
Sep 11 18:10:18.195678 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.195648    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb2c195c-a1f3-47c7-857b-27f307adeba8-maas-api-service-ca\") pod \"bb2c195c-a1f3-47c7-857b-27f307adeba8\" (UID: \"bb2c195c-a1f3-47c7-857b-27f307adeba8\") "
Sep 11 18:10:18.196058 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.196030    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb2c195c-a1f3-47c7-857b-27f307adeba8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bb2c195c-a1f3-47c7-857b-27f307adeba8" (UID: "bb2c195c-a1f3-47c7-857b-27f307adeba8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:10:18.297448 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.297367    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb2c195c-a1f3-47c7-857b-27f307adeba8-maas-api-service-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:10:18.556294 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.556223    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:10:18.600010 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.599978    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-data\") pod \"c463d835-3f37-4db6-88c7-cfeee71aff33\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") "
Sep 11 18:10:18.600202 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.600036    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-podinfo\") pod \"c463d835-3f37-4db6-88c7-cfeee71aff33\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") "
Sep 11 18:10:18.600202 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.600071    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-envoy\") pod \"c463d835-3f37-4db6-88c7-cfeee71aff33\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") "
Sep 11 18:10:18.600202 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.600121    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-credential-socket\") pod \"c463d835-3f37-4db6-88c7-cfeee71aff33\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") "
Sep 11 18:10:18.600202 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.600171    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c463d835-3f37-4db6-88c7-cfeee71aff33-istiod-ca-cert\") pod \"c463d835-3f37-4db6-88c7-cfeee71aff33\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") "
Sep 11 18:10:18.600425 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.600223    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-workload-certs\") pod \"c463d835-3f37-4db6-88c7-cfeee71aff33\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") "
Sep 11 18:10:18.600425 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.600250    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-token\") pod \"c463d835-3f37-4db6-88c7-cfeee71aff33\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") "
Sep 11 18:10:18.600425 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.600296    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-data" (OuterVolumeSpecName: "istio-data") pod "c463d835-3f37-4db6-88c7-cfeee71aff33" (UID: "c463d835-3f37-4db6-88c7-cfeee71aff33"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:10:18.600425 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.600310    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-workload-socket\") pod \"c463d835-3f37-4db6-88c7-cfeee71aff33\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") "
Sep 11 18:10:18.600425 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.600376    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghmjn\" (UniqueName: \"kubernetes.io/projected/c463d835-3f37-4db6-88c7-cfeee71aff33-kube-api-access-ghmjn\") pod \"c463d835-3f37-4db6-88c7-cfeee71aff33\" (UID: \"c463d835-3f37-4db6-88c7-cfeee71aff33\") "
Sep 11 18:10:18.600683 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.600524    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c463d835-3f37-4db6-88c7-cfeee71aff33" (UID: "c463d835-3f37-4db6-88c7-cfeee71aff33"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:10:18.600683 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.600558    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c463d835-3f37-4db6-88c7-cfeee71aff33" (UID: "c463d835-3f37-4db6-88c7-cfeee71aff33"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:10:18.600683 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.600657    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c463d835-3f37-4db6-88c7-cfeee71aff33-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c463d835-3f37-4db6-88c7-cfeee71aff33" (UID: "c463d835-3f37-4db6-88c7-cfeee71aff33"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:10:18.601318 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.601293    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-data\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:10:18.601318 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.601320    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-credential-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:10:18.601484 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.601333    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c463d835-3f37-4db6-88c7-cfeee71aff33-istiod-ca-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:10:18.601484 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.601367    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-workload-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:10:18.601484 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.601412    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c463d835-3f37-4db6-88c7-cfeee71aff33" (UID: "c463d835-3f37-4db6-88c7-cfeee71aff33"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:10:18.602426 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.602402    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c463d835-3f37-4db6-88c7-cfeee71aff33" (UID: "c463d835-3f37-4db6-88c7-cfeee71aff33"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:10:18.603128 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.603103    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-token" (OuterVolumeSpecName: "istio-token") pod "c463d835-3f37-4db6-88c7-cfeee71aff33" (UID: "c463d835-3f37-4db6-88c7-cfeee71aff33"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:10:18.603255 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.603133    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c463d835-3f37-4db6-88c7-cfeee71aff33" (UID: "c463d835-3f37-4db6-88c7-cfeee71aff33"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:10:18.603319 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.603275    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c463d835-3f37-4db6-88c7-cfeee71aff33-kube-api-access-ghmjn" (OuterVolumeSpecName: "kube-api-access-ghmjn") pod "c463d835-3f37-4db6-88c7-cfeee71aff33" (UID: "c463d835-3f37-4db6-88c7-cfeee71aff33"). InnerVolumeSpecName "kube-api-access-ghmjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:10:18.702718 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.702674    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-workload-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:10:18.702718 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.702711    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghmjn\" (UniqueName: \"kubernetes.io/projected/c463d835-3f37-4db6-88c7-cfeee71aff33-kube-api-access-ghmjn\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:10:18.703029 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.702726    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-podinfo\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:10:18.703029 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.702738    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-envoy\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:10:18.703029 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:18.702751    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c463d835-3f37-4db6-88c7-cfeee71aff33-istio-token\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:10:19.039278 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:19.039241    2579 generic.go:356] "Generic (PLEG): container finished" podID="c463d835-3f37-4db6-88c7-cfeee71aff33" containerID="717beea36d75c23dfd66585449f5e952efa1ce00ce556c3d327c1fff42fe438d" exitCode=0
Sep 11 18:10:19.039531 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:19.039288    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"
Sep 11 18:10:19.039531 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:19.039325    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr" event={"ID":"c463d835-3f37-4db6-88c7-cfeee71aff33","Type":"ContainerDied","Data":"717beea36d75c23dfd66585449f5e952efa1ce00ce556c3d327c1fff42fe438d"}
Sep 11 18:10:19.039531 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:19.039385    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr" event={"ID":"c463d835-3f37-4db6-88c7-cfeee71aff33","Type":"ContainerDied","Data":"3362b731ea62fbd4e8e27969eb47daa2dd52934e4a000b5d676192639fe46f5a"}
Sep 11 18:10:19.039531 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:19.039409    2579 scope.go:117] "RemoveContainer" containerID="717beea36d75c23dfd66585449f5e952efa1ce00ce556c3d327c1fff42fe438d"
Sep 11 18:10:19.040914 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:19.040890    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v" event={"ID":"bb2c195c-a1f3-47c7-857b-27f307adeba8","Type":"ContainerDied","Data":"db8f20ffed3af0243eaff57b69e8a60f0a79a7f5819977380e2d5b9815b3a110"}
Sep 11 18:10:19.041007 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:19.040937    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db8f20ffed3af0243eaff57b69e8a60f0a79a7f5819977380e2d5b9815b3a110"
Sep 11 18:10:19.041007 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:19.040900    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v"
Sep 11 18:10:19.050798 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:19.050780    2579 scope.go:117] "RemoveContainer" containerID="adff30c9ae1a01b8ff9fb2922aa83ef6651c3776f95494fd9e61ae3e790b1df2"
Sep 11 18:10:19.059622 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:19.059603    2579 scope.go:117] "RemoveContainer" containerID="717beea36d75c23dfd66585449f5e952efa1ce00ce556c3d327c1fff42fe438d"
Sep 11 18:10:19.059979 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:10:19.059958    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"717beea36d75c23dfd66585449f5e952efa1ce00ce556c3d327c1fff42fe438d\": container with ID starting with 717beea36d75c23dfd66585449f5e952efa1ce00ce556c3d327c1fff42fe438d not found: ID does not exist" containerID="717beea36d75c23dfd66585449f5e952efa1ce00ce556c3d327c1fff42fe438d"
Sep 11 18:10:19.060045 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:19.059991    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"717beea36d75c23dfd66585449f5e952efa1ce00ce556c3d327c1fff42fe438d"} err="failed to get container status \"717beea36d75c23dfd66585449f5e952efa1ce00ce556c3d327c1fff42fe438d\": rpc error: code = NotFound desc = could not find container \"717beea36d75c23dfd66585449f5e952efa1ce00ce556c3d327c1fff42fe438d\": container with ID starting with 717beea36d75c23dfd66585449f5e952efa1ce00ce556c3d327c1fff42fe438d not found: ID does not exist"
Sep 11 18:10:19.060045 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:19.060009    2579 scope.go:117] "RemoveContainer" containerID="adff30c9ae1a01b8ff9fb2922aa83ef6651c3776f95494fd9e61ae3e790b1df2"
Sep 11 18:10:19.060257 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:10:19.060237    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adff30c9ae1a01b8ff9fb2922aa83ef6651c3776f95494fd9e61ae3e790b1df2\": container with ID starting with adff30c9ae1a01b8ff9fb2922aa83ef6651c3776f95494fd9e61ae3e790b1df2 not found: ID does not exist" containerID="adff30c9ae1a01b8ff9fb2922aa83ef6651c3776f95494fd9e61ae3e790b1df2"
Sep 11 18:10:19.060296 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:19.060261    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adff30c9ae1a01b8ff9fb2922aa83ef6651c3776f95494fd9e61ae3e790b1df2"} err="failed to get container status \"adff30c9ae1a01b8ff9fb2922aa83ef6651c3776f95494fd9e61ae3e790b1df2\": rpc error: code = NotFound desc = could not find container \"adff30c9ae1a01b8ff9fb2922aa83ef6651c3776f95494fd9e61ae3e790b1df2\": container with ID starting with adff30c9ae1a01b8ff9fb2922aa83ef6651c3776f95494fd9e61ae3e790b1df2 not found: ID does not exist"
Sep 11 18:10:19.110695 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:19.110655    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"]
Sep 11 18:10:19.136314 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:19.136278    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr"]
Sep 11 18:10:19.534666 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:19.534633    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c463d835-3f37-4db6-88c7-cfeee71aff33" path="/var/lib/kubelet/pods/c463d835-3f37-4db6-88c7-cfeee71aff33/volumes"
Sep 11 18:10:29.521108 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:29.521062    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v"]
Sep 11 18:10:29.536734 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:29.536702    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1705a-2cw4v"]
Sep 11 18:10:31.534374 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:31.534301    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb2c195c-a1f3-47c7-857b-27f307adeba8" path="/var/lib/kubelet/pods/bb2c195c-a1f3-47c7-857b-27f307adeba8/volumes"
Sep 11 18:10:37.133652 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:37.133614    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"]
Sep 11 18:10:37.134193 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:37.133840    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq" podUID="0d772beb-1999-4a8f-b202-c68364690fce" containerName="istio-proxy" containerID="cri-o://d9bc2257aea30b96c582a2af4a1be8de9600993e600cb2a385eab2f197003632" gracePeriod=30
Sep 11 18:10:37.508928 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:37.508894    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fd32cd-62vjz"]
Sep 11 18:10:37.509582 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:37.509556    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c463d835-3f37-4db6-88c7-cfeee71aff33" containerName="istio-proxy"
Sep 11 18:10:37.509582 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:37.509582    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c463d835-3f37-4db6-88c7-cfeee71aff33" containerName="istio-proxy"
Sep 11 18:10:37.509788 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:37.509607    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb2c195c-a1f3-47c7-857b-27f307adeba8" containerName="revoke-keys"
Sep 11 18:10:37.509788 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:37.509616    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb2c195c-a1f3-47c7-857b-27f307adeba8" containerName="revoke-keys"
Sep 11 18:10:37.509788 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:37.509738    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c463d835-3f37-4db6-88c7-cfeee71aff33" containerName="istio-proxy"
Sep 11 18:10:37.509788 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:37.509752    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb2c195c-a1f3-47c7-857b-27f307adeba8" containerName="revoke-keys"
Sep 11 18:10:37.513129 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:37.513114    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fd32cd-62vjz"
Sep 11 18:10:37.514699 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:37.514673    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad57e14-1567-4262-8a0c-4180c1b1c1a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-fd32cd-62vjz\" (UID: \"fad57e14-1567-4262-8a0c-4180c1b1c1a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fd32cd-62vjz"
Sep 11 18:10:37.515907 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:37.515888    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 18:10:37.516340 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:37.516324    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 18:10:37.536513 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:37.536489    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fd32cd-62vjz"]
Sep 11 18:10:37.615376 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:37.615345    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad57e14-1567-4262-8a0c-4180c1b1c1a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-fd32cd-62vjz\" (UID: \"fad57e14-1567-4262-8a0c-4180c1b1c1a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fd32cd-62vjz"
Sep 11 18:10:37.616102 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:37.616082    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad57e14-1567-4262-8a0c-4180c1b1c1a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-fd32cd-62vjz\" (UID: \"fad57e14-1567-4262-8a0c-4180c1b1c1a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fd32cd-62vjz"
Sep 11 18:10:37.823852 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:37.823748    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fd32cd-62vjz"
Sep 11 18:10:38.103925 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:38.103897    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fd32cd-62vjz"]
Sep 11 18:10:38.105682 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:10:38.105644    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfad57e14_1567_4262_8a0c_4180c1b1c1a2.slice/crio-a5ea05c0abcc5235c545de45fd1ce5a35d295ea1c53b49531ac9862c254892e4 WatchSource:0}: Error finding container a5ea05c0abcc5235c545de45fd1ce5a35d295ea1c53b49531ac9862c254892e4: Status 404 returned error can't find the container with id a5ea05c0abcc5235c545de45fd1ce5a35d295ea1c53b49531ac9862c254892e4
Sep 11 18:10:38.149828 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:38.149800    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fd32cd-62vjz" event={"ID":"fad57e14-1567-4262-8a0c-4180c1b1c1a2","Type":"ContainerStarted","Data":"a5ea05c0abcc5235c545de45fd1ce5a35d295ea1c53b49531ac9862c254892e4"}
Sep 11 18:10:39.157676 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:39.157591    2579 generic.go:356] "Generic (PLEG): container finished" podID="fad57e14-1567-4262-8a0c-4180c1b1c1a2" containerID="1403723ac7e98ed752431776a09d87884f4cd3552f7cc941cb272ffe7aac5b95" exitCode=0
Sep 11 18:10:39.157676 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:39.157643    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fd32cd-62vjz" event={"ID":"fad57e14-1567-4262-8a0c-4180c1b1c1a2","Type":"ContainerDied","Data":"1403723ac7e98ed752431776a09d87884f4cd3552f7cc941cb272ffe7aac5b95"}
Sep 11 18:10:40.301527 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:40.301500    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fd32cd-62vjz"
Sep 11 18:10:40.342170 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:40.342141    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad57e14-1567-4262-8a0c-4180c1b1c1a2-maas-api-service-ca\") pod \"fad57e14-1567-4262-8a0c-4180c1b1c1a2\" (UID: \"fad57e14-1567-4262-8a0c-4180c1b1c1a2\") "
Sep 11 18:10:40.342587 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:40.342560    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fad57e14-1567-4262-8a0c-4180c1b1c1a2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fad57e14-1567-4262-8a0c-4180c1b1c1a2" (UID: "fad57e14-1567-4262-8a0c-4180c1b1c1a2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:10:40.443348 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:40.443263    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad57e14-1567-4262-8a0c-4180c1b1c1a2-maas-api-service-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:10:41.171119 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:41.171089    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fd32cd-62vjz"
Sep 11 18:10:41.171292 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:41.171090    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fd32cd-62vjz" event={"ID":"fad57e14-1567-4262-8a0c-4180c1b1c1a2","Type":"ContainerDied","Data":"a5ea05c0abcc5235c545de45fd1ce5a35d295ea1c53b49531ac9862c254892e4"}
Sep 11 18:10:41.171292 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:41.171211    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5ea05c0abcc5235c545de45fd1ce5a35d295ea1c53b49531ac9862c254892e4"
Sep 11 18:10:42.398530 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.398466    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:10:42.465212 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.465171    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-workload-certs\") pod \"0d772beb-1999-4a8f-b202-c68364690fce\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") "
Sep 11 18:10:42.465540 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.465517    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-credential-socket\") pod \"0d772beb-1999-4a8f-b202-c68364690fce\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") "
Sep 11 18:10:42.465731 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.465713    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-workload-socket\") pod \"0d772beb-1999-4a8f-b202-c68364690fce\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") "
Sep 11 18:10:42.466247 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.466228    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d772beb-1999-4a8f-b202-c68364690fce-istiod-ca-cert\") pod \"0d772beb-1999-4a8f-b202-c68364690fce\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") "
Sep 11 18:10:42.466468 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.466392    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d772beb-1999-4a8f-b202-c68364690fce-istio-token\") pod \"0d772beb-1999-4a8f-b202-c68364690fce\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") "
Sep 11 18:10:42.466696 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.466669    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d772beb-1999-4a8f-b202-c68364690fce-istio-podinfo\") pod \"0d772beb-1999-4a8f-b202-c68364690fce\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") "
Sep 11 18:10:42.466869 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.466721    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-istio-data\") pod \"0d772beb-1999-4a8f-b202-c68364690fce\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") "
Sep 11 18:10:42.466869 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.466774    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgmmf\" (UniqueName: \"kubernetes.io/projected/0d772beb-1999-4a8f-b202-c68364690fce-kube-api-access-jgmmf\") pod \"0d772beb-1999-4a8f-b202-c68364690fce\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") "
Sep 11 18:10:42.466869 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.466818    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-istio-envoy\") pod \"0d772beb-1999-4a8f-b202-c68364690fce\" (UID: \"0d772beb-1999-4a8f-b202-c68364690fce\") "
Sep 11 18:10:42.469248 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.465604    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0d772beb-1999-4a8f-b202-c68364690fce" (UID: "0d772beb-1999-4a8f-b202-c68364690fce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:10:42.469248 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.466116    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0d772beb-1999-4a8f-b202-c68364690fce" (UID: "0d772beb-1999-4a8f-b202-c68364690fce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:10:42.469248 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.466153    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0d772beb-1999-4a8f-b202-c68364690fce" (UID: "0d772beb-1999-4a8f-b202-c68364690fce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:10:42.469248 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.466818    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d772beb-1999-4a8f-b202-c68364690fce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0d772beb-1999-4a8f-b202-c68364690fce" (UID: "0d772beb-1999-4a8f-b202-c68364690fce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:10:42.469248 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.467367    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-istio-data" (OuterVolumeSpecName: "istio-data") pod "0d772beb-1999-4a8f-b202-c68364690fce" (UID: "0d772beb-1999-4a8f-b202-c68364690fce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:10:42.469574 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.469503    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0d772beb-1999-4a8f-b202-c68364690fce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0d772beb-1999-4a8f-b202-c68364690fce" (UID: "0d772beb-1999-4a8f-b202-c68364690fce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:10:42.470196 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.470169    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d772beb-1999-4a8f-b202-c68364690fce-kube-api-access-jgmmf" (OuterVolumeSpecName: "kube-api-access-jgmmf") pod "0d772beb-1999-4a8f-b202-c68364690fce" (UID: "0d772beb-1999-4a8f-b202-c68364690fce"). InnerVolumeSpecName "kube-api-access-jgmmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:10:42.470332 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.470309    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0d772beb-1999-4a8f-b202-c68364690fce" (UID: "0d772beb-1999-4a8f-b202-c68364690fce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:10:42.472136 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.472111    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d772beb-1999-4a8f-b202-c68364690fce-istio-token" (OuterVolumeSpecName: "istio-token") pod "0d772beb-1999-4a8f-b202-c68364690fce" (UID: "0d772beb-1999-4a8f-b202-c68364690fce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:10:42.567885 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.567847    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-credential-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:10:42.567885 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.567874    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-workload-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:10:42.567885 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.567885    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d772beb-1999-4a8f-b202-c68364690fce-istiod-ca-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:10:42.567885 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.567894    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d772beb-1999-4a8f-b202-c68364690fce-istio-token\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:10:42.568257 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.567905    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d772beb-1999-4a8f-b202-c68364690fce-istio-podinfo\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:10:42.568257 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.567917    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-istio-data\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:10:42.568257 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.567931    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgmmf\" (UniqueName: \"kubernetes.io/projected/0d772beb-1999-4a8f-b202-c68364690fce-kube-api-access-jgmmf\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:10:42.568257 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.567954    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-istio-envoy\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:10:42.568257 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:42.567966    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d772beb-1999-4a8f-b202-c68364690fce-workload-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:10:43.184990 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:43.184956    2579 generic.go:356] "Generic (PLEG): container finished" podID="0d772beb-1999-4a8f-b202-c68364690fce" containerID="d9bc2257aea30b96c582a2af4a1be8de9600993e600cb2a385eab2f197003632" exitCode=0
Sep 11 18:10:43.185206 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:43.185020    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq" event={"ID":"0d772beb-1999-4a8f-b202-c68364690fce","Type":"ContainerDied","Data":"d9bc2257aea30b96c582a2af4a1be8de9600993e600cb2a385eab2f197003632"}
Sep 11 18:10:43.185206 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:43.185028    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"
Sep 11 18:10:43.185206 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:43.185064    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq" event={"ID":"0d772beb-1999-4a8f-b202-c68364690fce","Type":"ContainerDied","Data":"23c54c6935dab3ad4e6269b8e601b243fbb8da740a9d7cefd7c562346b5cc8c7"}
Sep 11 18:10:43.185206 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:43.185086    2579 scope.go:117] "RemoveContainer" containerID="d9bc2257aea30b96c582a2af4a1be8de9600993e600cb2a385eab2f197003632"
Sep 11 18:10:43.195573 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:43.195554    2579 scope.go:117] "RemoveContainer" containerID="c38b469d26c32ddc2947b37d03da515dc0d874e360876bbf6cb8afe0632a2457"
Sep 11 18:10:43.203727 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:43.203708    2579 scope.go:117] "RemoveContainer" containerID="d9bc2257aea30b96c582a2af4a1be8de9600993e600cb2a385eab2f197003632"
Sep 11 18:10:43.204046 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:10:43.204025    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9bc2257aea30b96c582a2af4a1be8de9600993e600cb2a385eab2f197003632\": container with ID starting with d9bc2257aea30b96c582a2af4a1be8de9600993e600cb2a385eab2f197003632 not found: ID does not exist" containerID="d9bc2257aea30b96c582a2af4a1be8de9600993e600cb2a385eab2f197003632"
Sep 11 18:10:43.204129 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:43.204058    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9bc2257aea30b96c582a2af4a1be8de9600993e600cb2a385eab2f197003632"} err="failed to get container status \"d9bc2257aea30b96c582a2af4a1be8de9600993e600cb2a385eab2f197003632\": rpc error: code = NotFound desc = could not find container \"d9bc2257aea30b96c582a2af4a1be8de9600993e600cb2a385eab2f197003632\": container with ID starting with d9bc2257aea30b96c582a2af4a1be8de9600993e600cb2a385eab2f197003632 not found: ID does not exist"
Sep 11 18:10:43.204129 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:43.204093    2579 scope.go:117] "RemoveContainer" containerID="c38b469d26c32ddc2947b37d03da515dc0d874e360876bbf6cb8afe0632a2457"
Sep 11 18:10:43.204366 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:10:43.204350    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c38b469d26c32ddc2947b37d03da515dc0d874e360876bbf6cb8afe0632a2457\": container with ID starting with c38b469d26c32ddc2947b37d03da515dc0d874e360876bbf6cb8afe0632a2457 not found: ID does not exist" containerID="c38b469d26c32ddc2947b37d03da515dc0d874e360876bbf6cb8afe0632a2457"
Sep 11 18:10:43.204421 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:43.204375    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c38b469d26c32ddc2947b37d03da515dc0d874e360876bbf6cb8afe0632a2457"} err="failed to get container status \"c38b469d26c32ddc2947b37d03da515dc0d874e360876bbf6cb8afe0632a2457\": rpc error: code = NotFound desc = could not find container \"c38b469d26c32ddc2947b37d03da515dc0d874e360876bbf6cb8afe0632a2457\": container with ID starting with c38b469d26c32ddc2947b37d03da515dc0d874e360876bbf6cb8afe0632a2457 not found: ID does not exist"
Sep 11 18:10:43.221645 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:43.221621    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"]
Sep 11 18:10:43.234709 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:43.234681    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq"]
Sep 11 18:10:43.534720 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:43.534685    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d772beb-1999-4a8f-b202-c68364690fce" path="/var/lib/kubelet/pods/0d772beb-1999-4a8f-b202-c68364690fce/volumes"
Sep 11 18:10:48.664324 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:48.664282    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fd32cd-62vjz"]
Sep 11 18:10:48.668290 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:48.668256    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fd32cd-62vjz"]
Sep 11 18:10:49.535625 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:49.535591    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fad57e14-1567-4262-8a0c-4180c1b1c1a2" path="/var/lib/kubelet/pods/fad57e14-1567-4262-8a0c-4180c1b1c1a2/volumes"
Sep 11 18:10:56.663450 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:56.663414    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"]
Sep 11 18:10:56.663983 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:56.663617    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b" podUID="64907ac9-3935-4e9c-a5d7-52fffee5f300" containerName="istio-proxy" containerID="cri-o://de4551d63542ff17aebd6d42b9c4913ed81f3d6ad872bf9747aea1ba830d6c8f" gracePeriod=30
Sep 11 18:10:57.034332 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.034294    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f95803-fsm2n"]
Sep 11 18:10:57.034749 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.034736    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d772beb-1999-4a8f-b202-c68364690fce" containerName="istio-proxy"
Sep 11 18:10:57.034829 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.034751    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d772beb-1999-4a8f-b202-c68364690fce" containerName="istio-proxy"
Sep 11 18:10:57.034829 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.034783    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fad57e14-1567-4262-8a0c-4180c1b1c1a2" containerName="revoke-keys"
Sep 11 18:10:57.034829 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.034793    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fad57e14-1567-4262-8a0c-4180c1b1c1a2" containerName="revoke-keys"
Sep 11 18:10:57.034829 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.034808    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c463d835-3f37-4db6-88c7-cfeee71aff33" containerName="istio-proxy"
Sep 11 18:10:57.034829 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.034814    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c463d835-3f37-4db6-88c7-cfeee71aff33" containerName="istio-proxy"
Sep 11 18:10:57.034829 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.034823    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d772beb-1999-4a8f-b202-c68364690fce" containerName="istio-proxy"
Sep 11 18:10:57.034829 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.034829    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d772beb-1999-4a8f-b202-c68364690fce" containerName="istio-proxy"
Sep 11 18:10:57.035074 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.034902    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d772beb-1999-4a8f-b202-c68364690fce" containerName="istio-proxy"
Sep 11 18:10:57.035074 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.034910    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d772beb-1999-4a8f-b202-c68364690fce" containerName="istio-proxy"
Sep 11 18:10:57.035074 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.034919    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c463d835-3f37-4db6-88c7-cfeee71aff33" containerName="istio-proxy"
Sep 11 18:10:57.035074 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.034925    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fad57e14-1567-4262-8a0c-4180c1b1c1a2" containerName="revoke-keys"
Sep 11 18:10:57.039365 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.039348    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f95803-fsm2n"
Sep 11 18:10:57.043883 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.043861    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 18:10:57.044143 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.044129    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 18:10:57.064960 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.064930    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f95803-fsm2n"]
Sep 11 18:10:57.118452 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.118413    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-f95803-fsm2n\" (UID: \"b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f95803-fsm2n"
Sep 11 18:10:57.219551 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.219497    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-f95803-fsm2n\" (UID: \"b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f95803-fsm2n"
Sep 11 18:10:57.220159 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.220138    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-f95803-fsm2n\" (UID: \"b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f95803-fsm2n"
Sep 11 18:10:57.349608 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.349524    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f95803-fsm2n"
Sep 11 18:10:57.644594 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:57.644569    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f95803-fsm2n"]
Sep 11 18:10:57.647087 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:10:57.647056    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4fdd839_c46d_4174_ad9f_7bdc11e9a8c7.slice/crio-1527925bf053e4799dfc6375db9cbfd3246a1a32ef0d871c0d1229997dfc8c1a WatchSource:0}: Error finding container 1527925bf053e4799dfc6375db9cbfd3246a1a32ef0d871c0d1229997dfc8c1a: Status 404 returned error can't find the container with id 1527925bf053e4799dfc6375db9cbfd3246a1a32ef0d871c0d1229997dfc8c1a
Sep 11 18:10:58.271109 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:58.271071    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f95803-fsm2n" event={"ID":"b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7","Type":"ContainerStarted","Data":"d364fd101a8d6f3ee64130763ad8b61aa2c19e75a00ef8554ea91178e1d4c64c"}
Sep 11 18:10:58.271487 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:58.271158    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f95803-fsm2n" event={"ID":"b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7","Type":"ContainerStarted","Data":"1527925bf053e4799dfc6375db9cbfd3246a1a32ef0d871c0d1229997dfc8c1a"}
Sep 11 18:10:59.277997 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:59.277963    2579 generic.go:356] "Generic (PLEG): container finished" podID="b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7" containerID="d364fd101a8d6f3ee64130763ad8b61aa2c19e75a00ef8554ea91178e1d4c64c" exitCode=0
Sep 11 18:10:59.278398 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:10:59.278029    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f95803-fsm2n" event={"ID":"b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7","Type":"ContainerDied","Data":"d364fd101a8d6f3ee64130763ad8b61aa2c19e75a00ef8554ea91178e1d4c64c"}
Sep 11 18:11:00.414749 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:00.414718    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f95803-fsm2n"
Sep 11 18:11:00.555376 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:00.555289    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7-maas-api-service-ca\") pod \"b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7\" (UID: \"b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7\") "
Sep 11 18:11:00.555659 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:00.555637    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7" (UID: "b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:11:00.656683 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:00.656650    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7-maas-api-service-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:11:01.289739 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:01.289709    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f95803-fsm2n"
Sep 11 18:11:01.289929 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:01.289705    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f95803-fsm2n" event={"ID":"b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7","Type":"ContainerDied","Data":"1527925bf053e4799dfc6375db9cbfd3246a1a32ef0d871c0d1229997dfc8c1a"}
Sep 11 18:11:01.289929 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:01.289819    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1527925bf053e4799dfc6375db9cbfd3246a1a32ef0d871c0d1229997dfc8c1a"
Sep 11 18:11:01.928978 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:01.928910    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:11:02.069856 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.069819    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-workload-certs\") pod \"64907ac9-3935-4e9c-a5d7-52fffee5f300\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") "
Sep 11 18:11:02.070012 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.069894    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-podinfo\") pod \"64907ac9-3935-4e9c-a5d7-52fffee5f300\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") "
Sep 11 18:11:02.070012 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.069918    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcrxm\" (UniqueName: \"kubernetes.io/projected/64907ac9-3935-4e9c-a5d7-52fffee5f300-kube-api-access-dcrxm\") pod \"64907ac9-3935-4e9c-a5d7-52fffee5f300\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") "
Sep 11 18:11:02.070012 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.069952    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-token\") pod \"64907ac9-3935-4e9c-a5d7-52fffee5f300\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") "
Sep 11 18:11:02.070012 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.069980    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64907ac9-3935-4e9c-a5d7-52fffee5f300-istiod-ca-cert\") pod \"64907ac9-3935-4e9c-a5d7-52fffee5f300\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") "
Sep 11 18:11:02.070228 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.070044    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-data\") pod \"64907ac9-3935-4e9c-a5d7-52fffee5f300\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") "
Sep 11 18:11:02.070228 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.070112    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-envoy\") pod \"64907ac9-3935-4e9c-a5d7-52fffee5f300\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") "
Sep 11 18:11:02.070228 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.070117    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "64907ac9-3935-4e9c-a5d7-52fffee5f300" (UID: "64907ac9-3935-4e9c-a5d7-52fffee5f300"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:11:02.070228 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.070140    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-credential-socket\") pod \"64907ac9-3935-4e9c-a5d7-52fffee5f300\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") "
Sep 11 18:11:02.070228 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.070172    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-workload-socket\") pod \"64907ac9-3935-4e9c-a5d7-52fffee5f300\" (UID: \"64907ac9-3935-4e9c-a5d7-52fffee5f300\") "
Sep 11 18:11:02.070473 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.070378    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64907ac9-3935-4e9c-a5d7-52fffee5f300-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "64907ac9-3935-4e9c-a5d7-52fffee5f300" (UID: "64907ac9-3935-4e9c-a5d7-52fffee5f300"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:11:02.070473 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.070388    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-data" (OuterVolumeSpecName: "istio-data") pod "64907ac9-3935-4e9c-a5d7-52fffee5f300" (UID: "64907ac9-3935-4e9c-a5d7-52fffee5f300"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:11:02.070473 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.070439    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "64907ac9-3935-4e9c-a5d7-52fffee5f300" (UID: "64907ac9-3935-4e9c-a5d7-52fffee5f300"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:11:02.070618 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.070594    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "64907ac9-3935-4e9c-a5d7-52fffee5f300" (UID: "64907ac9-3935-4e9c-a5d7-52fffee5f300"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:11:02.070730 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.070714    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64907ac9-3935-4e9c-a5d7-52fffee5f300-istiod-ca-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:11:02.070809 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.070733    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-data\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:11:02.070809 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.070747    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-credential-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:11:02.070809 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.070787    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-workload-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:11:02.070809 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.070803    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-workload-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:11:02.072280 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.072251    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "64907ac9-3935-4e9c-a5d7-52fffee5f300" (UID: "64907ac9-3935-4e9c-a5d7-52fffee5f300"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:11:02.072384 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.072257    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "64907ac9-3935-4e9c-a5d7-52fffee5f300" (UID: "64907ac9-3935-4e9c-a5d7-52fffee5f300"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:11:02.072384 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.072329    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-token" (OuterVolumeSpecName: "istio-token") pod "64907ac9-3935-4e9c-a5d7-52fffee5f300" (UID: "64907ac9-3935-4e9c-a5d7-52fffee5f300"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:11:02.072473 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.072454    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64907ac9-3935-4e9c-a5d7-52fffee5f300-kube-api-access-dcrxm" (OuterVolumeSpecName: "kube-api-access-dcrxm") pod "64907ac9-3935-4e9c-a5d7-52fffee5f300" (UID: "64907ac9-3935-4e9c-a5d7-52fffee5f300"). InnerVolumeSpecName "kube-api-access-dcrxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:11:02.172145 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.172111    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-token\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:11:02.172145 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.172140    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-envoy\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:11:02.172145 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.172151    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64907ac9-3935-4e9c-a5d7-52fffee5f300-istio-podinfo\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:11:02.172376 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.172160    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcrxm\" (UniqueName: \"kubernetes.io/projected/64907ac9-3935-4e9c-a5d7-52fffee5f300-kube-api-access-dcrxm\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:11:02.297000 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.296965    2579 generic.go:356] "Generic (PLEG): container finished" podID="64907ac9-3935-4e9c-a5d7-52fffee5f300" containerID="de4551d63542ff17aebd6d42b9c4913ed81f3d6ad872bf9747aea1ba830d6c8f" exitCode=0
Sep 11 18:11:02.297175 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.297020    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"
Sep 11 18:11:02.297175 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.297028    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b" event={"ID":"64907ac9-3935-4e9c-a5d7-52fffee5f300","Type":"ContainerDied","Data":"de4551d63542ff17aebd6d42b9c4913ed81f3d6ad872bf9747aea1ba830d6c8f"}
Sep 11 18:11:02.297175 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.297070    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b" event={"ID":"64907ac9-3935-4e9c-a5d7-52fffee5f300","Type":"ContainerDied","Data":"393cccf7e0ba5c6e2bf96771c049069614ebb41417b0dafaad8fd392990d0fbb"}
Sep 11 18:11:02.297175 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.297094    2579 scope.go:117] "RemoveContainer" containerID="de4551d63542ff17aebd6d42b9c4913ed81f3d6ad872bf9747aea1ba830d6c8f"
Sep 11 18:11:02.307439 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.307420    2579 scope.go:117] "RemoveContainer" containerID="13662d212164c648ba97552e878108fe04283e397b1343daf6ff988a96502851"
Sep 11 18:11:02.315844 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.315823    2579 scope.go:117] "RemoveContainer" containerID="de4551d63542ff17aebd6d42b9c4913ed81f3d6ad872bf9747aea1ba830d6c8f"
Sep 11 18:11:02.316100 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:11:02.316082    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de4551d63542ff17aebd6d42b9c4913ed81f3d6ad872bf9747aea1ba830d6c8f\": container with ID starting with de4551d63542ff17aebd6d42b9c4913ed81f3d6ad872bf9747aea1ba830d6c8f not found: ID does not exist" containerID="de4551d63542ff17aebd6d42b9c4913ed81f3d6ad872bf9747aea1ba830d6c8f"
Sep 11 18:11:02.316145 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.316107    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de4551d63542ff17aebd6d42b9c4913ed81f3d6ad872bf9747aea1ba830d6c8f"} err="failed to get container status \"de4551d63542ff17aebd6d42b9c4913ed81f3d6ad872bf9747aea1ba830d6c8f\": rpc error: code = NotFound desc = could not find container \"de4551d63542ff17aebd6d42b9c4913ed81f3d6ad872bf9747aea1ba830d6c8f\": container with ID starting with de4551d63542ff17aebd6d42b9c4913ed81f3d6ad872bf9747aea1ba830d6c8f not found: ID does not exist"
Sep 11 18:11:02.316145 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.316125    2579 scope.go:117] "RemoveContainer" containerID="13662d212164c648ba97552e878108fe04283e397b1343daf6ff988a96502851"
Sep 11 18:11:02.316378 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:11:02.316360    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13662d212164c648ba97552e878108fe04283e397b1343daf6ff988a96502851\": container with ID starting with 13662d212164c648ba97552e878108fe04283e397b1343daf6ff988a96502851 not found: ID does not exist" containerID="13662d212164c648ba97552e878108fe04283e397b1343daf6ff988a96502851"
Sep 11 18:11:02.316468 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.316389    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13662d212164c648ba97552e878108fe04283e397b1343daf6ff988a96502851"} err="failed to get container status \"13662d212164c648ba97552e878108fe04283e397b1343daf6ff988a96502851\": rpc error: code = NotFound desc = could not find container \"13662d212164c648ba97552e878108fe04283e397b1343daf6ff988a96502851\": container with ID starting with 13662d212164c648ba97552e878108fe04283e397b1343daf6ff988a96502851 not found: ID does not exist"
Sep 11 18:11:02.326657 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.326627    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"]
Sep 11 18:11:02.333075 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:02.333046    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b"]
Sep 11 18:11:03.534544 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:03.534508    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64907ac9-3935-4e9c-a5d7-52fffee5f300" path="/var/lib/kubelet/pods/64907ac9-3935-4e9c-a5d7-52fffee5f300/volumes"
Sep 11 18:11:07.899680 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:07.899652    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f95803-fsm2n"]
Sep 11 18:11:07.906570 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:07.906542    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f95803-fsm2n"]
Sep 11 18:11:09.534411 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:09.534375    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7" path="/var/lib/kubelet/pods/b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7/volumes"
Sep 11 18:11:14.242012 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.241977    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"]
Sep 11 18:11:14.242448 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.242433    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64907ac9-3935-4e9c-a5d7-52fffee5f300" containerName="istio-proxy"
Sep 11 18:11:14.242506 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.242449    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="64907ac9-3935-4e9c-a5d7-52fffee5f300" containerName="istio-proxy"
Sep 11 18:11:14.242506 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.242458    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7" containerName="revoke-keys"
Sep 11 18:11:14.242506 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.242463    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7" containerName="revoke-keys"
Sep 11 18:11:14.242608 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.242553    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="64907ac9-3935-4e9c-a5d7-52fffee5f300" containerName="istio-proxy"
Sep 11 18:11:14.242608 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.242566    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4fdd839-c46d-4174-ad9f-7bdc11e9a8c7" containerName="revoke-keys"
Sep 11 18:11:14.250272 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.250245    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.265032 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.265006    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-6ad962-openshift-default-dockercfg-x97z4\""
Sep 11 18:11:14.297951 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.297918    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"]
Sep 11 18:11:14.298944 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.298919    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-token\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.299010 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.298981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-workload-socket\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.299049 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.299010    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-podinfo\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.299049 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.299043    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-data\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.299135 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.299113    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-workload-certs\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.299194 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.299180    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-envoy\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.299242 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.299231    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istiod-ca-cert\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.299289 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.299250    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4d9t\" (UniqueName: \"kubernetes.io/projected/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-kube-api-access-s4d9t\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.299389 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.299368    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-credential-socket\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.400443 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.400400    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istiod-ca-cert\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.400443 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.400443    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4d9t\" (UniqueName: \"kubernetes.io/projected/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-kube-api-access-s4d9t\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.400696 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.400488    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-credential-socket\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.400696 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.400507    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-token\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.400696 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.400539    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-workload-socket\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.400696 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.400558    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-podinfo\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.400696 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.400597    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-data\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.400696 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.400638    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-workload-certs\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.400696 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.400685    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-envoy\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.401122 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.400997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-workload-socket\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.401122 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.401021    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-credential-socket\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.401122 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.401103    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-data\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.401272 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.401243    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istiod-ca-cert\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.401272 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.401244    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-workload-certs\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.403016 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.402999    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-envoy\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.403154 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.403136    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-podinfo\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.416148 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.416122    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4d9t\" (UniqueName: \"kubernetes.io/projected/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-kube-api-access-s4d9t\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.416816 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.416799    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-token\") pod \"e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") " pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.560862 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.560755    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:14.852885 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.852858    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"]
Sep 11 18:11:14.854814 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:11:14.854789    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb7a44ea_e4cb_44d7_9162_9a34f79af06c.slice/crio-6000a56c119524a41fce1b4a64b27ab67184a4e9b70cba5f6a24c5c6c76d11bd WatchSource:0}: Error finding container 6000a56c119524a41fce1b4a64b27ab67184a4e9b70cba5f6a24c5c6c76d11bd: Status 404 returned error can't find the container with id 6000a56c119524a41fce1b4a64b27ab67184a4e9b70cba5f6a24c5c6c76d11bd
Sep 11 18:11:14.857009 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.856975    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:11:14.857127 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.857057    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:11:14.857127 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:14.857099    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:11:15.009226 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:15.009194    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"]
Sep 11 18:11:15.009737 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:15.009709    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9" podUID="9ef73d8e-4792-4f4e-973a-9362697ed49e" containerName="istio-proxy" containerID="cri-o://7ac8d3a3f4c12d1ea2c9a0c7aa3a4aee0d4eda7b5fc1474b11d933345a5822ef" gracePeriod=30
Sep 11 18:11:15.371371 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:15.371328    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr" event={"ID":"fb7a44ea-e4cb-44d7-9162-9a34f79af06c","Type":"ContainerStarted","Data":"1a50935d6ef2346a12b2d0a16c473e2339e7ffcabd7710c420f44465c629e37b"}
Sep 11 18:11:15.371792 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:15.371393    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr" event={"ID":"fb7a44ea-e4cb-44d7-9162-9a34f79af06c","Type":"ContainerStarted","Data":"6000a56c119524a41fce1b4a64b27ab67184a4e9b70cba5f6a24c5c6c76d11bd"}
Sep 11 18:11:15.395224 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:15.395170    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr" podStartSLOduration=1.39515249 podStartE2EDuration="1.39515249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:11:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:11:15.392076406 +0000 UTC m=+1568.318028176" watchObservedRunningTime="2026-09-11 18:11:15.39515249 +0000 UTC m=+1568.321104235"
Sep 11 18:11:15.561153 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:15.561119    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:15.565708 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:15.565685    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:16.378027 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:16.377998    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:16.379144 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:16.379122    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:20.271536 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.271499    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:11:20.366504 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.366406    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-credential-socket\") pod \"9ef73d8e-4792-4f4e-973a-9362697ed49e\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") "
Sep 11 18:11:20.366504 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.366454    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-workload-socket\") pod \"9ef73d8e-4792-4f4e-973a-9362697ed49e\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") "
Sep 11 18:11:20.366504 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.366490    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-podinfo\") pod \"9ef73d8e-4792-4f4e-973a-9362697ed49e\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") "
Sep 11 18:11:20.367047 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.366542    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nr6j8\" (UniqueName: \"kubernetes.io/projected/9ef73d8e-4792-4f4e-973a-9362697ed49e-kube-api-access-nr6j8\") pod \"9ef73d8e-4792-4f4e-973a-9362697ed49e\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") "
Sep 11 18:11:20.367047 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.366571    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-data\") pod \"9ef73d8e-4792-4f4e-973a-9362697ed49e\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") "
Sep 11 18:11:20.367047 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.366723    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9ef73d8e-4792-4f4e-973a-9362697ed49e" (UID: "9ef73d8e-4792-4f4e-973a-9362697ed49e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:11:20.367047 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.366810    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9ef73d8e-4792-4f4e-973a-9362697ed49e" (UID: "9ef73d8e-4792-4f4e-973a-9362697ed49e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:11:20.367047 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.366893    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-envoy\") pod \"9ef73d8e-4792-4f4e-973a-9362697ed49e\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") "
Sep 11 18:11:20.367047 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.367009    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-token\") pod \"9ef73d8e-4792-4f4e-973a-9362697ed49e\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") "
Sep 11 18:11:20.367474 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.367121    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-workload-certs\") pod \"9ef73d8e-4792-4f4e-973a-9362697ed49e\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") "
Sep 11 18:11:20.367474 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.367160    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ef73d8e-4792-4f4e-973a-9362697ed49e-istiod-ca-cert\") pod \"9ef73d8e-4792-4f4e-973a-9362697ed49e\" (UID: \"9ef73d8e-4792-4f4e-973a-9362697ed49e\") "
Sep 11 18:11:20.367474 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.367410    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9ef73d8e-4792-4f4e-973a-9362697ed49e" (UID: "9ef73d8e-4792-4f4e-973a-9362697ed49e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:11:20.367795 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.367690    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-workload-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:11:20.367795 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.367718    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-credential-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:11:20.367795 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.367724    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-data" (OuterVolumeSpecName: "istio-data") pod "9ef73d8e-4792-4f4e-973a-9362697ed49e" (UID: "9ef73d8e-4792-4f4e-973a-9362697ed49e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:11:20.367795 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.367733    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-workload-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:11:20.367795 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.367781    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ef73d8e-4792-4f4e-973a-9362697ed49e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9ef73d8e-4792-4f4e-973a-9362697ed49e" (UID: "9ef73d8e-4792-4f4e-973a-9362697ed49e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:11:20.370013 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.369962    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9ef73d8e-4792-4f4e-973a-9362697ed49e" (UID: "9ef73d8e-4792-4f4e-973a-9362697ed49e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:11:20.374493 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.374452    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ef73d8e-4792-4f4e-973a-9362697ed49e-kube-api-access-nr6j8" (OuterVolumeSpecName: "kube-api-access-nr6j8") pod "9ef73d8e-4792-4f4e-973a-9362697ed49e" (UID: "9ef73d8e-4792-4f4e-973a-9362697ed49e"). InnerVolumeSpecName "kube-api-access-nr6j8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:11:20.374917 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.374883    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-token" (OuterVolumeSpecName: "istio-token") pod "9ef73d8e-4792-4f4e-973a-9362697ed49e" (UID: "9ef73d8e-4792-4f4e-973a-9362697ed49e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:11:20.376245 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.376164    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9ef73d8e-4792-4f4e-973a-9362697ed49e" (UID: "9ef73d8e-4792-4f4e-973a-9362697ed49e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:11:20.402724 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.402693    2579 generic.go:356] "Generic (PLEG): container finished" podID="9ef73d8e-4792-4f4e-973a-9362697ed49e" containerID="7ac8d3a3f4c12d1ea2c9a0c7aa3a4aee0d4eda7b5fc1474b11d933345a5822ef" exitCode=0
Sep 11 18:11:20.402854 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.402749    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"
Sep 11 18:11:20.402854 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.402788    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9" event={"ID":"9ef73d8e-4792-4f4e-973a-9362697ed49e","Type":"ContainerDied","Data":"7ac8d3a3f4c12d1ea2c9a0c7aa3a4aee0d4eda7b5fc1474b11d933345a5822ef"}
Sep 11 18:11:20.402932 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.402875    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9" event={"ID":"9ef73d8e-4792-4f4e-973a-9362697ed49e","Type":"ContainerDied","Data":"d12eef6cd2639fb14927fe55db5ef1f4c98ce6fd8e56d52bd7ed7c284f98fec9"}
Sep 11 18:11:20.402932 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.402899    2579 scope.go:117] "RemoveContainer" containerID="7ac8d3a3f4c12d1ea2c9a0c7aa3a4aee0d4eda7b5fc1474b11d933345a5822ef"
Sep 11 18:11:20.412348 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.412327    2579 scope.go:117] "RemoveContainer" containerID="ffd5c032158ad224cc6f6bec5918acafc2e6f6a0e31ff22c4d530120125edd78"
Sep 11 18:11:20.420591 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.420573    2579 scope.go:117] "RemoveContainer" containerID="7ac8d3a3f4c12d1ea2c9a0c7aa3a4aee0d4eda7b5fc1474b11d933345a5822ef"
Sep 11 18:11:20.420857 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:11:20.420838    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ac8d3a3f4c12d1ea2c9a0c7aa3a4aee0d4eda7b5fc1474b11d933345a5822ef\": container with ID starting with 7ac8d3a3f4c12d1ea2c9a0c7aa3a4aee0d4eda7b5fc1474b11d933345a5822ef not found: ID does not exist" containerID="7ac8d3a3f4c12d1ea2c9a0c7aa3a4aee0d4eda7b5fc1474b11d933345a5822ef"
Sep 11 18:11:20.420929 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.420866    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ac8d3a3f4c12d1ea2c9a0c7aa3a4aee0d4eda7b5fc1474b11d933345a5822ef"} err="failed to get container status \"7ac8d3a3f4c12d1ea2c9a0c7aa3a4aee0d4eda7b5fc1474b11d933345a5822ef\": rpc error: code = NotFound desc = could not find container \"7ac8d3a3f4c12d1ea2c9a0c7aa3a4aee0d4eda7b5fc1474b11d933345a5822ef\": container with ID starting with 7ac8d3a3f4c12d1ea2c9a0c7aa3a4aee0d4eda7b5fc1474b11d933345a5822ef not found: ID does not exist"
Sep 11 18:11:20.420929 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.420882    2579 scope.go:117] "RemoveContainer" containerID="ffd5c032158ad224cc6f6bec5918acafc2e6f6a0e31ff22c4d530120125edd78"
Sep 11 18:11:20.421121 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:11:20.421102    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffd5c032158ad224cc6f6bec5918acafc2e6f6a0e31ff22c4d530120125edd78\": container with ID starting with ffd5c032158ad224cc6f6bec5918acafc2e6f6a0e31ff22c4d530120125edd78 not found: ID does not exist" containerID="ffd5c032158ad224cc6f6bec5918acafc2e6f6a0e31ff22c4d530120125edd78"
Sep 11 18:11:20.421163 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.421128    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffd5c032158ad224cc6f6bec5918acafc2e6f6a0e31ff22c4d530120125edd78"} err="failed to get container status \"ffd5c032158ad224cc6f6bec5918acafc2e6f6a0e31ff22c4d530120125edd78\": rpc error: code = NotFound desc = could not find container \"ffd5c032158ad224cc6f6bec5918acafc2e6f6a0e31ff22c4d530120125edd78\": container with ID starting with ffd5c032158ad224cc6f6bec5918acafc2e6f6a0e31ff22c4d530120125edd78 not found: ID does not exist"
Sep 11 18:11:20.433474 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.433437    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"]
Sep 11 18:11:20.435440 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.435418    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9"]
Sep 11 18:11:20.468961 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.468933    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-podinfo\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:11:20.468961 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.468959    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr6j8\" (UniqueName: \"kubernetes.io/projected/9ef73d8e-4792-4f4e-973a-9362697ed49e-kube-api-access-nr6j8\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:11:20.469107 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.468971    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-data\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:11:20.469107 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.468979    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-envoy\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:11:20.469107 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.468987    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ef73d8e-4792-4f4e-973a-9362697ed49e-istio-token\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:11:20.469107 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:20.468994    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ef73d8e-4792-4f4e-973a-9362697ed49e-istiod-ca-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:11:21.534902 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:21.534872    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ef73d8e-4792-4f4e-973a-9362697ed49e" path="/var/lib/kubelet/pods/9ef73d8e-4792-4f4e-973a-9362697ed49e/volumes"
Sep 11 18:11:32.418936 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:32.418888    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 18:11:32.419350 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:32.418959    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr" podUID="fb7a44ea-e4cb-44d7-9162-9a34f79af06c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 18:11:34.485961 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:34.485929    2579 generic.go:356] "Generic (PLEG): container finished" podID="fb7a44ea-e4cb-44d7-9162-9a34f79af06c" containerID="1a50935d6ef2346a12b2d0a16c473e2339e7ffcabd7710c420f44465c629e37b" exitCode=0
Sep 11 18:11:34.486405 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:34.486002    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr" event={"ID":"fb7a44ea-e4cb-44d7-9162-9a34f79af06c","Type":"ContainerDied","Data":"1a50935d6ef2346a12b2d0a16c473e2339e7ffcabd7710c420f44465c629e37b"}
Sep 11 18:11:34.486405 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:34.486402    2579 scope.go:117] "RemoveContainer" containerID="1a50935d6ef2346a12b2d0a16c473e2339e7ffcabd7710c420f44465c629e37b"
Sep 11 18:11:34.487478 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:34.487448    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:11:34.487582 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:34.487536    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:11:34.487643 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:34.487582    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:11:35.508882 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:35.508834    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr" event={"ID":"fb7a44ea-e4cb-44d7-9162-9a34f79af06c","Type":"ContainerStarted","Data":"ed778336dae0feaaeb54501bb04b70b89a7bddaf84da74b498918eee21f0d640"}
Sep 11 18:11:35.561925 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:35.561891    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:35.562162 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:35.562101    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 11 18:11:35.562245 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:35.562163    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr" podUID="fb7a44ea-e4cb-44d7-9162-9a34f79af06c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 11 18:11:36.561365 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:36.561328    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 11 18:11:36.561746 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:36.561388    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr" podUID="fb7a44ea-e4cb-44d7-9162-9a34f79af06c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 11 18:11:37.561937 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:37.561902    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 11 18:11:37.562300 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:37.561968    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr" podUID="fb7a44ea-e4cb-44d7-9162-9a34f79af06c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 11 18:11:38.561433 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:38.561400    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 11 18:11:38.561633 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:38.561475    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr" podUID="fb7a44ea-e4cb-44d7-9162-9a34f79af06c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 11 18:11:39.561245 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:39.561210    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 11 18:11:39.561634 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:39.561266    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr" podUID="fb7a44ea-e4cb-44d7-9162-9a34f79af06c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 11 18:11:40.565457 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:40.565429    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:40.565850 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:40.565790    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:40.566505 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:40.566484    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:11:48.768025 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.767988    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"]
Sep 11 18:11:48.768436 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.768423    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ef73d8e-4792-4f4e-973a-9362697ed49e" containerName="istio-proxy"
Sep 11 18:11:48.768486 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.768438    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ef73d8e-4792-4f4e-973a-9362697ed49e" containerName="istio-proxy"
Sep 11 18:11:48.768486 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.768453    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ef73d8e-4792-4f4e-973a-9362697ed49e" containerName="istio-proxy"
Sep 11 18:11:48.768486 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.768459    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ef73d8e-4792-4f4e-973a-9362697ed49e" containerName="istio-proxy"
Sep 11 18:11:48.768486 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.768470    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64907ac9-3935-4e9c-a5d7-52fffee5f300" containerName="istio-proxy"
Sep 11 18:11:48.768486 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.768476    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="64907ac9-3935-4e9c-a5d7-52fffee5f300" containerName="istio-proxy"
Sep 11 18:11:48.768642 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.768542    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="64907ac9-3935-4e9c-a5d7-52fffee5f300" containerName="istio-proxy"
Sep 11 18:11:48.768642 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.768550    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ef73d8e-4792-4f4e-973a-9362697ed49e" containerName="istio-proxy"
Sep 11 18:11:48.770863 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.770847    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.773912 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.773888    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-b54eb6-openshift-default-dockercfg-cgg4j\""
Sep 11 18:11:48.857148 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.857116    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"]
Sep 11 18:11:48.874291 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.874258    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-token\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.874462 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.874307    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istiod-ca-cert\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.874462 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.874376    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-credential-socket\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.874462 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.874454    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cr9d\" (UniqueName: \"kubernetes.io/projected/addc00a0-02d5-4d5b-a872-a9f43465f7c4-kube-api-access-5cr9d\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.874585 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.874534    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-workload-socket\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.874585 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.874571    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-workload-certs\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.874683 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.874590    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-data\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.874739 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.874708    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-envoy\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.874844 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.874778    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-podinfo\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.976067 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.976032    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-workload-socket\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.976244 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.976083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-workload-certs\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.976244 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.976111    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-data\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.976244 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.976155    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-envoy\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.976244 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.976191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-podinfo\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.976244 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.976218    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-token\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.976244 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.976245    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istiod-ca-cert\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.976567 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.976275    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-credential-socket\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.976567 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.976319    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cr9d\" (UniqueName: \"kubernetes.io/projected/addc00a0-02d5-4d5b-a872-a9f43465f7c4-kube-api-access-5cr9d\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.976567 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.976486    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-workload-certs\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.976567 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.976530    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-workload-socket\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.976751 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.976572    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-data\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.976751 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.976711    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-credential-socket\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.977159 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.977133    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istiod-ca-cert\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.978548 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.978527    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-envoy\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.979090 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.979068    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-podinfo\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.986151 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.986132    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cr9d\" (UniqueName: \"kubernetes.io/projected/addc00a0-02d5-4d5b-a872-a9f43465f7c4-kube-api-access-5cr9d\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:48.986229 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:48.986191    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-token\") pod \"e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") " pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:49.082636 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:49.082554    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:49.363524 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:49.363498    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"]
Sep 11 18:11:49.365474 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:11:49.365440    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaddc00a0_02d5_4d5b_a872_a9f43465f7c4.slice/crio-6b6ad7628eb6d407d5fc0100e2b2b722f965acfb0559df0d554f86d3aedd220f WatchSource:0}: Error finding container 6b6ad7628eb6d407d5fc0100e2b2b722f965acfb0559df0d554f86d3aedd220f: Status 404 returned error can't find the container with id 6b6ad7628eb6d407d5fc0100e2b2b722f965acfb0559df0d554f86d3aedd220f
Sep 11 18:11:49.367808 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:49.367745    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:11:49.367917 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:49.367847    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:11:49.367917 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:49.367882    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:11:49.596024 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:49.595982    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6" event={"ID":"addc00a0-02d5-4d5b-a872-a9f43465f7c4","Type":"ContainerStarted","Data":"22ddb0e60874cfda6589ffaf41d9ffbaa86edd711f653406fc3a1c706ba85c3a"}
Sep 11 18:11:49.596212 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:49.596045    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6" event={"ID":"addc00a0-02d5-4d5b-a872-a9f43465f7c4","Type":"ContainerStarted","Data":"6b6ad7628eb6d407d5fc0100e2b2b722f965acfb0559df0d554f86d3aedd220f"}
Sep 11 18:11:49.619582 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:49.619465    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6" podStartSLOduration=1.619446984 podStartE2EDuration="1.619446984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:11:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:11:49.617670529 +0000 UTC m=+1602.543622276" watchObservedRunningTime="2026-09-11 18:11:49.619446984 +0000 UTC m=+1602.545398729"
Sep 11 18:11:50.083268 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:50.083227    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:50.088564 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:50.088508    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:50.601700 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:50.601667    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:11:50.602823 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:11:50.602801    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:12:10.712928 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:12:10.712849    2579 generic.go:356] "Generic (PLEG): container finished" podID="addc00a0-02d5-4d5b-a872-a9f43465f7c4" containerID="22ddb0e60874cfda6589ffaf41d9ffbaa86edd711f653406fc3a1c706ba85c3a" exitCode=0
Sep 11 18:12:10.713319 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:12:10.712923    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6" event={"ID":"addc00a0-02d5-4d5b-a872-a9f43465f7c4","Type":"ContainerDied","Data":"22ddb0e60874cfda6589ffaf41d9ffbaa86edd711f653406fc3a1c706ba85c3a"}
Sep 11 18:12:10.713381 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:12:10.713365    2579 scope.go:117] "RemoveContainer" containerID="22ddb0e60874cfda6589ffaf41d9ffbaa86edd711f653406fc3a1c706ba85c3a"
Sep 11 18:12:10.714459 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:12:10.714434    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:12:10.714523 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:12:10.714498    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:12:10.714560 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:12:10.714530    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:12:11.720829 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:12:11.720796    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6" event={"ID":"addc00a0-02d5-4d5b-a872-a9f43465f7c4","Type":"ContainerStarted","Data":"fa192eae77a0c0cfd537e83841400edd3d13e4f9a7018dfbea767e407b58395c"}
Sep 11 18:12:12.083687 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:12:12.083639    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:12:12.083962 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:12:12.083939    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 11 18:12:12.084085 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:12:12.083992    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6" podUID="addc00a0-02d5-4d5b-a872-a9f43465f7c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 11 18:12:13.083148 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:12:13.083112    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 11 18:12:13.083522 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:12:13.083165    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6" podUID="addc00a0-02d5-4d5b-a872-a9f43465f7c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 11 18:12:14.083285 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:12:14.083244    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 11 18:12:14.083751 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:12:14.083308    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6" podUID="addc00a0-02d5-4d5b-a872-a9f43465f7c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 11 18:12:15.083079 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:12:15.083038    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 11 18:12:15.083259 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:12:15.083101    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6" podUID="addc00a0-02d5-4d5b-a872-a9f43465f7c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 11 18:12:16.083814 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:12:16.083743    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 11 18:12:16.084210 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:12:16.083842    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6" podUID="addc00a0-02d5-4d5b-a872-a9f43465f7c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 11 18:12:17.087181 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:12:17.087140    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:12:17.087551 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:12:17.087406    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:12:17.088029 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:12:17.088008    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:13:07.908839 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:07.908806    2579 scope.go:117] "RemoveContainer" containerID="e0bd197dd2bdf21c83ab725b87d23f5f76d820f8f2568b6067b536dee55d0591"
Sep 11 18:13:24.121444 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.121405    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"]
Sep 11 18:13:24.122059 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.122041    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ef73d8e-4792-4f4e-973a-9362697ed49e" containerName="istio-proxy"
Sep 11 18:13:24.124247 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.124232    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.127066 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.127044    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-4f951a-openshift-default-dockercfg-97kbw\""
Sep 11 18:13:24.139745 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.139722    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"]
Sep 11 18:13:24.250031 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.249991    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-podinfo\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.250222 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.250057    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-data\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.250222 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.250120    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-workload-certs\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.250222 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.250162    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-workload-socket\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.250222 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.250185    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zr4x\" (UniqueName: \"kubernetes.io/projected/8500a12f-03af-4f4b-a4dd-703872dff52b-kube-api-access-2zr4x\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.250448 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.250305    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8500a12f-03af-4f4b-a4dd-703872dff52b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.250448 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.250340    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-envoy\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.250448 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.250367    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-token\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.250602 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.250478    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-credential-socket\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.351788 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.351722    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-credential-socket\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.352013 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.351817    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-podinfo\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.352013 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.351870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-data\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.352013 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.351906    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-workload-certs\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.352013 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.351943    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-workload-socket\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.352013 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.351973    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zr4x\" (UniqueName: \"kubernetes.io/projected/8500a12f-03af-4f4b-a4dd-703872dff52b-kube-api-access-2zr4x\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.352307 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.352049    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8500a12f-03af-4f4b-a4dd-703872dff52b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.352307 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.352082    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-envoy\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.352307 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.352224    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-credential-socket\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.352307 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.352276    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-token\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.352307 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.352282    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-workload-socket\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.352573 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.352376    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-data\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.352573 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.352555    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-workload-certs\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.352831 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.352809    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8500a12f-03af-4f4b-a4dd-703872dff52b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.354214 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.354197    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-envoy\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.354470 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.354453    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-podinfo\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.360737 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.360710    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-token\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.360908 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.360889    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zr4x\" (UniqueName: \"kubernetes.io/projected/8500a12f-03af-4f4b-a4dd-703872dff52b-kube-api-access-2zr4x\") pod \"e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") " pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.434852 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.434743    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:24.711544 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.711419    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"]
Sep 11 18:13:24.714866 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:13:24.714827    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8500a12f_03af_4f4b_a4dd_703872dff52b.slice/crio-5f6d3bc3f2816b241934bc19169b77e77bfd73d71bd9e15f071bb59038575b72 WatchSource:0}: Error finding container 5f6d3bc3f2816b241934bc19169b77e77bfd73d71bd9e15f071bb59038575b72: Status 404 returned error can't find the container with id 5f6d3bc3f2816b241934bc19169b77e77bfd73d71bd9e15f071bb59038575b72
Sep 11 18:13:24.717325 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.717292    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:13:24.717413 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.717359    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:13:24.717413 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:24.717386    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:13:25.146507 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:25.146469    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9" event={"ID":"8500a12f-03af-4f4b-a4dd-703872dff52b","Type":"ContainerStarted","Data":"cf436d3f65bcf4c20a1bafc2752e2088e0601e40743e928550ddf39f9eb75bcf"}
Sep 11 18:13:25.146906 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:25.146552    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9" event={"ID":"8500a12f-03af-4f4b-a4dd-703872dff52b","Type":"ContainerStarted","Data":"5f6d3bc3f2816b241934bc19169b77e77bfd73d71bd9e15f071bb59038575b72"}
Sep 11 18:13:25.171654 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:25.171590    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9" podStartSLOduration=1.171574737 podStartE2EDuration="1.171574737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:13:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:13:25.168739311 +0000 UTC m=+1698.094691057" watchObservedRunningTime="2026-09-11 18:13:25.171574737 +0000 UTC m=+1698.097526523"
Sep 11 18:13:25.435927 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:25.435836    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:25.441557 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:25.441522    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:26.152044 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:26.152013    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:26.153035 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:26.153013    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:46.276176 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:46.276144    2579 generic.go:356] "Generic (PLEG): container finished" podID="8500a12f-03af-4f4b-a4dd-703872dff52b" containerID="cf436d3f65bcf4c20a1bafc2752e2088e0601e40743e928550ddf39f9eb75bcf" exitCode=0
Sep 11 18:13:46.276598 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:46.276187    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9" event={"ID":"8500a12f-03af-4f4b-a4dd-703872dff52b","Type":"ContainerDied","Data":"cf436d3f65bcf4c20a1bafc2752e2088e0601e40743e928550ddf39f9eb75bcf"}
Sep 11 18:13:46.276643 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:46.276602    2579 scope.go:117] "RemoveContainer" containerID="cf436d3f65bcf4c20a1bafc2752e2088e0601e40743e928550ddf39f9eb75bcf"
Sep 11 18:13:46.277808 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:46.277751    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:13:46.277903 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:46.277848    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:13:46.277903 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:46.277879    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:13:47.284277 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:47.284242    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9" event={"ID":"8500a12f-03af-4f4b-a4dd-703872dff52b","Type":"ContainerStarted","Data":"eeb87521a30849b34103ed5de12f576169c5f2fd61a1b3a374c2ba017859523f"}
Sep 11 18:13:47.435830 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:47.435790    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:47.436056 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:47.436027    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 11 18:13:47.436151 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:47.436125    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9" podUID="8500a12f-03af-4f4b-a4dd-703872dff52b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 11 18:13:48.435636 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:48.435597    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 11 18:13:48.436033 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:48.435653    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9" podUID="8500a12f-03af-4f4b-a4dd-703872dff52b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 11 18:13:49.435684 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:49.435647    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 11 18:13:49.436111 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:49.435706    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9" podUID="8500a12f-03af-4f4b-a4dd-703872dff52b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 11 18:13:50.435725 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:50.435686    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 11 18:13:50.436141 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:50.435743    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9" podUID="8500a12f-03af-4f4b-a4dd-703872dff52b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 11 18:13:51.436113 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:51.436070    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 11 18:13:51.436520 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:51.436133    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9" podUID="8500a12f-03af-4f4b-a4dd-703872dff52b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 11 18:13:52.435398 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:52.435359    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 11 18:13:52.435589 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:52.435421    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9" podUID="8500a12f-03af-4f4b-a4dd-703872dff52b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 11 18:13:53.439277 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:53.439245    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:53.439744 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:53.439520    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:53.440331 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:53.440309    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:13:58.040222 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:58.040194    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4f951a-4qfv2"]
Sep 11 18:13:58.043303 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:58.043280    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4f951a-4qfv2"
Sep 11 18:13:58.045712 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:58.045690    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 18:13:58.045847 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:58.045799    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 18:13:58.052779 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:58.052732    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4f951a-4qfv2"]
Sep 11 18:13:58.127720 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:58.127684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e0dd330-29b8-4765-acdb-dc2b74a73394-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-4f951a-4qfv2\" (UID: \"2e0dd330-29b8-4765-acdb-dc2b74a73394\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4f951a-4qfv2"
Sep 11 18:13:58.228668 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:58.228634    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e0dd330-29b8-4765-acdb-dc2b74a73394-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-4f951a-4qfv2\" (UID: \"2e0dd330-29b8-4765-acdb-dc2b74a73394\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4f951a-4qfv2"
Sep 11 18:13:58.229277 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:58.229248    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e0dd330-29b8-4765-acdb-dc2b74a73394-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-4f951a-4qfv2\" (UID: \"2e0dd330-29b8-4765-acdb-dc2b74a73394\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4f951a-4qfv2"
Sep 11 18:13:58.355256 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:58.355181    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4f951a-4qfv2"
Sep 11 18:13:58.626785 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:58.626741    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4f951a-4qfv2"]
Sep 11 18:13:58.628279 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:13:58.628242    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e0dd330_29b8_4765_acdb_dc2b74a73394.slice/crio-0f24ca8039ae1c6cea78638f66e7f71acfe33a76145d5337e4be0b12ecf72201 WatchSource:0}: Error finding container 0f24ca8039ae1c6cea78638f66e7f71acfe33a76145d5337e4be0b12ecf72201: Status 404 returned error can't find the container with id 0f24ca8039ae1c6cea78638f66e7f71acfe33a76145d5337e4be0b12ecf72201
Sep 11 18:13:59.366464 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:59.366431    2579 generic.go:356] "Generic (PLEG): container finished" podID="2e0dd330-29b8-4765-acdb-dc2b74a73394" containerID="31c4a741b55696e1a8899fa59ae0ba7f3f059490342aecd6ec19e3118a00ae72" exitCode=0
Sep 11 18:13:59.366911 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:59.366518    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4f951a-4qfv2" event={"ID":"2e0dd330-29b8-4765-acdb-dc2b74a73394","Type":"ContainerDied","Data":"31c4a741b55696e1a8899fa59ae0ba7f3f059490342aecd6ec19e3118a00ae72"}
Sep 11 18:13:59.366911 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:13:59.366586    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4f951a-4qfv2" event={"ID":"2e0dd330-29b8-4765-acdb-dc2b74a73394","Type":"ContainerStarted","Data":"0f24ca8039ae1c6cea78638f66e7f71acfe33a76145d5337e4be0b12ecf72201"}
Sep 11 18:14:00.521249 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:00.521221    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4f951a-4qfv2"
Sep 11 18:14:00.556084 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:00.556050    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e0dd330-29b8-4765-acdb-dc2b74a73394-maas-api-service-ca\") pod \"2e0dd330-29b8-4765-acdb-dc2b74a73394\" (UID: \"2e0dd330-29b8-4765-acdb-dc2b74a73394\") "
Sep 11 18:14:00.556440 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:00.556414    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e0dd330-29b8-4765-acdb-dc2b74a73394-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2e0dd330-29b8-4765-acdb-dc2b74a73394" (UID: "2e0dd330-29b8-4765-acdb-dc2b74a73394"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:14:00.657284 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:00.657194    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e0dd330-29b8-4765-acdb-dc2b74a73394-maas-api-service-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:14:01.379470 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:01.379442    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4f951a-4qfv2"
Sep 11 18:14:01.379650 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:01.379485    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4f951a-4qfv2" event={"ID":"2e0dd330-29b8-4765-acdb-dc2b74a73394","Type":"ContainerDied","Data":"0f24ca8039ae1c6cea78638f66e7f71acfe33a76145d5337e4be0b12ecf72201"}
Sep 11 18:14:01.379650 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:01.379531    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f24ca8039ae1c6cea78638f66e7f71acfe33a76145d5337e4be0b12ecf72201"
Sep 11 18:14:09.079193 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:09.079153    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4f951a-4qfv2"]
Sep 11 18:14:09.082739 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:09.082698    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4f951a-4qfv2"]
Sep 11 18:14:09.534632 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:09.534598    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e0dd330-29b8-4765-acdb-dc2b74a73394" path="/var/lib/kubelet/pods/2e0dd330-29b8-4765-acdb-dc2b74a73394/volumes"
Sep 11 18:14:15.794718 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:15.794680    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"]
Sep 11 18:14:15.795195 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:15.794971    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9" podUID="8500a12f-03af-4f4b-a4dd-703872dff52b" containerName="istio-proxy" containerID="cri-o://eeb87521a30849b34103ed5de12f576169c5f2fd61a1b3a374c2ba017859523f" gracePeriod=30
Sep 11 18:14:19.670334 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:19.670301    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6ad962-5qrms"]
Sep 11 18:14:19.670781 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:19.670751    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e0dd330-29b8-4765-acdb-dc2b74a73394" containerName="revoke-keys"
Sep 11 18:14:19.670781 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:19.670782    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e0dd330-29b8-4765-acdb-dc2b74a73394" containerName="revoke-keys"
Sep 11 18:14:19.670882 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:19.670870    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e0dd330-29b8-4765-acdb-dc2b74a73394" containerName="revoke-keys"
Sep 11 18:14:19.673026 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:19.673009    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6ad962-5qrms"
Sep 11 18:14:19.676202 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:19.676179    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 18:14:19.676310 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:19.676210    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 18:14:19.683181 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:19.683155    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6ad962-5qrms"]
Sep 11 18:14:19.764841 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:19.764794    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84f4d106-8f9f-4b9c-ba71-227b14c32bfb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-6ad962-5qrms\" (UID: \"84f4d106-8f9f-4b9c-ba71-227b14c32bfb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6ad962-5qrms"
Sep 11 18:14:19.865473 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:19.865430    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84f4d106-8f9f-4b9c-ba71-227b14c32bfb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-6ad962-5qrms\" (UID: \"84f4d106-8f9f-4b9c-ba71-227b14c32bfb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6ad962-5qrms"
Sep 11 18:14:19.866058 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:19.866037    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84f4d106-8f9f-4b9c-ba71-227b14c32bfb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-6ad962-5qrms\" (UID: \"84f4d106-8f9f-4b9c-ba71-227b14c32bfb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6ad962-5qrms"
Sep 11 18:14:19.985755 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:19.985645    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6ad962-5qrms"
Sep 11 18:14:20.256860 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:20.256831    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6ad962-5qrms"]
Sep 11 18:14:20.259029 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:14:20.259003    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84f4d106_8f9f_4b9c_ba71_227b14c32bfb.slice/crio-d64f75f5fbdb06ff51c4372229b044c002f5916edf6a42a06b058a612658211d WatchSource:0}: Error finding container d64f75f5fbdb06ff51c4372229b044c002f5916edf6a42a06b058a612658211d: Status 404 returned error can't find the container with id d64f75f5fbdb06ff51c4372229b044c002f5916edf6a42a06b058a612658211d
Sep 11 18:14:20.496012 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:20.495976    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6ad962-5qrms" event={"ID":"84f4d106-8f9f-4b9c-ba71-227b14c32bfb","Type":"ContainerStarted","Data":"d64f75f5fbdb06ff51c4372229b044c002f5916edf6a42a06b058a612658211d"}
Sep 11 18:14:21.049164 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.049139    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:14:21.077088 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.077058    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-workload-socket\") pod \"8500a12f-03af-4f4b-a4dd-703872dff52b\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") "
Sep 11 18:14:21.077278 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.077097    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-workload-certs\") pod \"8500a12f-03af-4f4b-a4dd-703872dff52b\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") "
Sep 11 18:14:21.077278 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.077121    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-envoy\") pod \"8500a12f-03af-4f4b-a4dd-703872dff52b\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") "
Sep 11 18:14:21.077278 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.077147    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8500a12f-03af-4f4b-a4dd-703872dff52b-istiod-ca-cert\") pod \"8500a12f-03af-4f4b-a4dd-703872dff52b\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") "
Sep 11 18:14:21.077278 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.077196    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zr4x\" (UniqueName: \"kubernetes.io/projected/8500a12f-03af-4f4b-a4dd-703872dff52b-kube-api-access-2zr4x\") pod \"8500a12f-03af-4f4b-a4dd-703872dff52b\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") "
Sep 11 18:14:21.077278 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.077253    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-data\") pod \"8500a12f-03af-4f4b-a4dd-703872dff52b\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") "
Sep 11 18:14:21.077557 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.077304    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-podinfo\") pod \"8500a12f-03af-4f4b-a4dd-703872dff52b\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") "
Sep 11 18:14:21.077557 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.077397    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-token\") pod \"8500a12f-03af-4f4b-a4dd-703872dff52b\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") "
Sep 11 18:14:21.077557 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.077390    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8500a12f-03af-4f4b-a4dd-703872dff52b" (UID: "8500a12f-03af-4f4b-a4dd-703872dff52b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:14:21.077557 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.077422    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8500a12f-03af-4f4b-a4dd-703872dff52b" (UID: "8500a12f-03af-4f4b-a4dd-703872dff52b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:14:21.077557 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.077421    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-credential-socket\") pod \"8500a12f-03af-4f4b-a4dd-703872dff52b\" (UID: \"8500a12f-03af-4f4b-a4dd-703872dff52b\") "
Sep 11 18:14:21.077848 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.077646    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8500a12f-03af-4f4b-a4dd-703872dff52b" (UID: "8500a12f-03af-4f4b-a4dd-703872dff52b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:14:21.078029 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.077917    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-credential-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:14:21.078029 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.077936    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8500a12f-03af-4f4b-a4dd-703872dff52b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8500a12f-03af-4f4b-a4dd-703872dff52b" (UID: "8500a12f-03af-4f4b-a4dd-703872dff52b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:14:21.078029 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.077944    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-workload-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:14:21.078029 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.077984    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-workload-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:14:21.078277 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.078046    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-data" (OuterVolumeSpecName: "istio-data") pod "8500a12f-03af-4f4b-a4dd-703872dff52b" (UID: "8500a12f-03af-4f4b-a4dd-703872dff52b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:14:21.079836 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.079800    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-token" (OuterVolumeSpecName: "istio-token") pod "8500a12f-03af-4f4b-a4dd-703872dff52b" (UID: "8500a12f-03af-4f4b-a4dd-703872dff52b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:14:21.079929 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.079905    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8500a12f-03af-4f4b-a4dd-703872dff52b" (UID: "8500a12f-03af-4f4b-a4dd-703872dff52b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:14:21.079979 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.079960    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8500a12f-03af-4f4b-a4dd-703872dff52b" (UID: "8500a12f-03af-4f4b-a4dd-703872dff52b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:14:21.080103 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.080085    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8500a12f-03af-4f4b-a4dd-703872dff52b-kube-api-access-2zr4x" (OuterVolumeSpecName: "kube-api-access-2zr4x") pod "8500a12f-03af-4f4b-a4dd-703872dff52b" (UID: "8500a12f-03af-4f4b-a4dd-703872dff52b"). InnerVolumeSpecName "kube-api-access-2zr4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:14:21.179506 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.179411    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-token\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:14:21.179506 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.179438    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-envoy\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:14:21.179506 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.179450    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8500a12f-03af-4f4b-a4dd-703872dff52b-istiod-ca-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:14:21.179506 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.179458    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zr4x\" (UniqueName: \"kubernetes.io/projected/8500a12f-03af-4f4b-a4dd-703872dff52b-kube-api-access-2zr4x\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:14:21.179506 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.179468    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-data\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:14:21.179506 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.179477    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8500a12f-03af-4f4b-a4dd-703872dff52b-istio-podinfo\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:14:21.503875 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.503842    2579 generic.go:356] "Generic (PLEG): container finished" podID="8500a12f-03af-4f4b-a4dd-703872dff52b" containerID="eeb87521a30849b34103ed5de12f576169c5f2fd61a1b3a374c2ba017859523f" exitCode=0
Sep 11 18:14:21.504092 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.503897    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"
Sep 11 18:14:21.504092 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.503920    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9" event={"ID":"8500a12f-03af-4f4b-a4dd-703872dff52b","Type":"ContainerDied","Data":"eeb87521a30849b34103ed5de12f576169c5f2fd61a1b3a374c2ba017859523f"}
Sep 11 18:14:21.504092 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.503965    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9" event={"ID":"8500a12f-03af-4f4b-a4dd-703872dff52b","Type":"ContainerDied","Data":"5f6d3bc3f2816b241934bc19169b77e77bfd73d71bd9e15f071bb59038575b72"}
Sep 11 18:14:21.504092 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.503994    2579 scope.go:117] "RemoveContainer" containerID="eeb87521a30849b34103ed5de12f576169c5f2fd61a1b3a374c2ba017859523f"
Sep 11 18:14:21.505695 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.505669    2579 generic.go:356] "Generic (PLEG): container finished" podID="84f4d106-8f9f-4b9c-ba71-227b14c32bfb" containerID="be0e095bde0b8131405ea42506fac36c0ce16349b607f6c9cedeabd8da1caa5a" exitCode=0
Sep 11 18:14:21.505840 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.505735    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6ad962-5qrms" event={"ID":"84f4d106-8f9f-4b9c-ba71-227b14c32bfb","Type":"ContainerDied","Data":"be0e095bde0b8131405ea42506fac36c0ce16349b607f6c9cedeabd8da1caa5a"}
Sep 11 18:14:21.514864 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.514845    2579 scope.go:117] "RemoveContainer" containerID="cf436d3f65bcf4c20a1bafc2752e2088e0601e40743e928550ddf39f9eb75bcf"
Sep 11 18:14:21.523555 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.523538    2579 scope.go:117] "RemoveContainer" containerID="eeb87521a30849b34103ed5de12f576169c5f2fd61a1b3a374c2ba017859523f"
Sep 11 18:14:21.523838 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:14:21.523820    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeb87521a30849b34103ed5de12f576169c5f2fd61a1b3a374c2ba017859523f\": container with ID starting with eeb87521a30849b34103ed5de12f576169c5f2fd61a1b3a374c2ba017859523f not found: ID does not exist" containerID="eeb87521a30849b34103ed5de12f576169c5f2fd61a1b3a374c2ba017859523f"
Sep 11 18:14:21.523887 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.523846    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeb87521a30849b34103ed5de12f576169c5f2fd61a1b3a374c2ba017859523f"} err="failed to get container status \"eeb87521a30849b34103ed5de12f576169c5f2fd61a1b3a374c2ba017859523f\": rpc error: code = NotFound desc = could not find container \"eeb87521a30849b34103ed5de12f576169c5f2fd61a1b3a374c2ba017859523f\": container with ID starting with eeb87521a30849b34103ed5de12f576169c5f2fd61a1b3a374c2ba017859523f not found: ID does not exist"
Sep 11 18:14:21.523887 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.523864    2579 scope.go:117] "RemoveContainer" containerID="cf436d3f65bcf4c20a1bafc2752e2088e0601e40743e928550ddf39f9eb75bcf"
Sep 11 18:14:21.524095 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:14:21.524077    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf436d3f65bcf4c20a1bafc2752e2088e0601e40743e928550ddf39f9eb75bcf\": container with ID starting with cf436d3f65bcf4c20a1bafc2752e2088e0601e40743e928550ddf39f9eb75bcf not found: ID does not exist" containerID="cf436d3f65bcf4c20a1bafc2752e2088e0601e40743e928550ddf39f9eb75bcf"
Sep 11 18:14:21.524141 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.524101    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf436d3f65bcf4c20a1bafc2752e2088e0601e40743e928550ddf39f9eb75bcf"} err="failed to get container status \"cf436d3f65bcf4c20a1bafc2752e2088e0601e40743e928550ddf39f9eb75bcf\": rpc error: code = NotFound desc = could not find container \"cf436d3f65bcf4c20a1bafc2752e2088e0601e40743e928550ddf39f9eb75bcf\": container with ID starting with cf436d3f65bcf4c20a1bafc2752e2088e0601e40743e928550ddf39f9eb75bcf not found: ID does not exist"
Sep 11 18:14:21.541119 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.541083    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"]
Sep 11 18:14:21.549297 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:21.549273    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9"]
Sep 11 18:14:22.657387 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:22.657359    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6ad962-5qrms"
Sep 11 18:14:22.694961 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:22.694927    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84f4d106-8f9f-4b9c-ba71-227b14c32bfb-maas-api-service-ca\") pod \"84f4d106-8f9f-4b9c-ba71-227b14c32bfb\" (UID: \"84f4d106-8f9f-4b9c-ba71-227b14c32bfb\") "
Sep 11 18:14:22.695280 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:22.695259    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84f4d106-8f9f-4b9c-ba71-227b14c32bfb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "84f4d106-8f9f-4b9c-ba71-227b14c32bfb" (UID: "84f4d106-8f9f-4b9c-ba71-227b14c32bfb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:14:22.796843 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:22.796699    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84f4d106-8f9f-4b9c-ba71-227b14c32bfb-maas-api-service-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:14:23.520026 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:23.519985    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6ad962-5qrms" event={"ID":"84f4d106-8f9f-4b9c-ba71-227b14c32bfb","Type":"ContainerDied","Data":"d64f75f5fbdb06ff51c4372229b044c002f5916edf6a42a06b058a612658211d"}
Sep 11 18:14:23.520175 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:23.520071    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d64f75f5fbdb06ff51c4372229b044c002f5916edf6a42a06b058a612658211d"
Sep 11 18:14:23.520175 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:23.520004    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6ad962-5qrms"
Sep 11 18:14:23.534009 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:23.533984    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8500a12f-03af-4f4b-a4dd-703872dff52b" path="/var/lib/kubelet/pods/8500a12f-03af-4f4b-a4dd-703872dff52b/volumes"
Sep 11 18:14:35.648329 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:35.648293    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6ad962-5qrms"]
Sep 11 18:14:35.650534 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:35.650502    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6ad962-5qrms"]
Sep 11 18:14:37.534801 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:14:37.534744    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84f4d106-8f9f-4b9c-ba71-227b14c32bfb" path="/var/lib/kubelet/pods/84f4d106-8f9f-4b9c-ba71-227b14c32bfb/volumes"
Sep 11 18:15:00.163151 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.163114    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819175-7dqpk"]
Sep 11 18:15:00.163785 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.163732    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8500a12f-03af-4f4b-a4dd-703872dff52b" containerName="istio-proxy"
Sep 11 18:15:00.163785 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.163782    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8500a12f-03af-4f4b-a4dd-703872dff52b" containerName="istio-proxy"
Sep 11 18:15:00.163976 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.163804    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84f4d106-8f9f-4b9c-ba71-227b14c32bfb" containerName="revoke-keys"
Sep 11 18:15:00.163976 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.163813    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="84f4d106-8f9f-4b9c-ba71-227b14c32bfb" containerName="revoke-keys"
Sep 11 18:15:00.163976 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.163839    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8500a12f-03af-4f4b-a4dd-703872dff52b" containerName="istio-proxy"
Sep 11 18:15:00.163976 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.163849    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8500a12f-03af-4f4b-a4dd-703872dff52b" containerName="istio-proxy"
Sep 11 18:15:00.163976 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.163975    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="84f4d106-8f9f-4b9c-ba71-227b14c32bfb" containerName="revoke-keys"
Sep 11 18:15:00.164224 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.163988    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8500a12f-03af-4f4b-a4dd-703872dff52b" containerName="istio-proxy"
Sep 11 18:15:00.164224 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.164001    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8500a12f-03af-4f4b-a4dd-703872dff52b" containerName="istio-proxy"
Sep 11 18:15:00.166116 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.166092    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-b54eb6-29819175-2p5c2"]
Sep 11 18:15:00.166242 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.166204    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819175-7dqpk"
Sep 11 18:15:00.168571 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.168552    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-b54eb6-29819175-2p5c2"
Sep 11 18:15:00.169206 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.169183    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 18:15:00.173901 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.173874    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819175-7dqpk"]
Sep 11 18:15:00.176643 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.176613    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-b54eb6-29819175-2p5c2"]
Sep 11 18:15:00.180874 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.180855    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819175-7dqpk"
Sep 11 18:15:00.189400 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.189378    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-b54eb6-29819175-2p5c2"
Sep 11 18:15:00.463041 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.462877    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819175-7dqpk"]
Sep 11 18:15:00.488512 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.480332    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-b54eb6-29819175-2p5c2"]
Sep 11 18:15:00.738163 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.738126    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-b54eb6-29819175-2p5c2" event={"ID":"2d715a23-1279-4823-b164-ae6ab39023ac","Type":"ContainerStarted","Data":"554402a92148d5b73f43593c910616edbf37e944961e84089c2993ae31a0c217"}
Sep 11 18:15:00.738340 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.738191    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-b54eb6-29819175-2p5c2" event={"ID":"2d715a23-1279-4823-b164-ae6ab39023ac","Type":"ContainerStarted","Data":"c17bd35202b4c812fd05471f47205f78835a7f66e40802a14b961e7f1b1d2d86"}
Sep 11 18:15:00.739401 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.739375    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819175-7dqpk" event={"ID":"c41dc829-160a-499b-aa18-2eae6f1c4ed3","Type":"ContainerStarted","Data":"d87bf76a5ee862873f2a139ec255e0883dadbf028988f576b5dc3ca11a22c5aa"}
Sep 11 18:15:00.756733 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:00.756688    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-b54eb6-29819175-2p5c2" podStartSLOduration=0.756674712 podStartE2EDuration="756.674712ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:15:00.754099289 +0000 UTC m=+1793.680051035" watchObservedRunningTime="2026-09-11 18:15:00.756674712 +0000 UTC m=+1793.682626458"
Sep 11 18:15:01.746378 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:01.746343    2579 generic.go:356] "Generic (PLEG): container finished" podID="c41dc829-160a-499b-aa18-2eae6f1c4ed3" containerID="b1998147c19240d72cc4e780adffead8fedda6f6c83190ba6b166ee13e0f65eb" exitCode=0
Sep 11 18:15:01.746827 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:01.746437    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819175-7dqpk" event={"ID":"c41dc829-160a-499b-aa18-2eae6f1c4ed3","Type":"ContainerDied","Data":"b1998147c19240d72cc4e780adffead8fedda6f6c83190ba6b166ee13e0f65eb"}
Sep 11 18:15:01.748046 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:01.748027    2579 generic.go:356] "Generic (PLEG): container finished" podID="2d715a23-1279-4823-b164-ae6ab39023ac" containerID="554402a92148d5b73f43593c910616edbf37e944961e84089c2993ae31a0c217" exitCode=0
Sep 11 18:15:01.748118 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:01.748085    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-b54eb6-29819175-2p5c2" event={"ID":"2d715a23-1279-4823-b164-ae6ab39023ac","Type":"ContainerDied","Data":"554402a92148d5b73f43593c910616edbf37e944961e84089c2993ae31a0c217"}
Sep 11 18:15:02.925452 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:02.925429    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819175-7dqpk"
Sep 11 18:15:02.928599 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:02.928580    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-b54eb6-29819175-2p5c2"
Sep 11 18:15:03.760997 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:03.760968    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-b54eb6-29819175-2p5c2"
Sep 11 18:15:03.761178 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:03.761002    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-b54eb6-29819175-2p5c2" event={"ID":"2d715a23-1279-4823-b164-ae6ab39023ac","Type":"ContainerDied","Data":"c17bd35202b4c812fd05471f47205f78835a7f66e40802a14b961e7f1b1d2d86"}
Sep 11 18:15:03.761178 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:03.761050    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c17bd35202b4c812fd05471f47205f78835a7f66e40802a14b961e7f1b1d2d86"
Sep 11 18:15:03.762463 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:03.762444    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819175-7dqpk"
Sep 11 18:15:03.762571 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:03.762456    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819175-7dqpk" event={"ID":"c41dc829-160a-499b-aa18-2eae6f1c4ed3","Type":"ContainerDied","Data":"d87bf76a5ee862873f2a139ec255e0883dadbf028988f576b5dc3ca11a22c5aa"}
Sep 11 18:15:03.762571 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:03.762497    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d87bf76a5ee862873f2a139ec255e0883dadbf028988f576b5dc3ca11a22c5aa"
Sep 11 18:15:07.635781 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:07.635735    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-bbhjk_46c0eccf-9fc2-4fbf-ae39-3b1cf093b352/console-operator/1.log"
Sep 11 18:15:07.640032 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:07.640008    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zx6_cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd/ovn-acl-logging/0.log"
Sep 11 18:15:07.641359 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:07.641330    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-bbhjk_46c0eccf-9fc2-4fbf-ae39-3b1cf093b352/console-operator/1.log"
Sep 11 18:15:07.645335 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:07.645315    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zx6_cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd/ovn-acl-logging/0.log"
Sep 11 18:15:24.369510 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:24.369477    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"]
Sep 11 18:15:24.369922 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:24.369685    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr" podUID="fb7a44ea-e4cb-44d7-9162-9a34f79af06c" containerName="istio-proxy" containerID="cri-o://ed778336dae0feaaeb54501bb04b70b89a7bddaf84da74b498918eee21f0d640" gracePeriod=30
Sep 11 18:15:24.785568 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:24.785530    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b54eb6-7krz6"]
Sep 11 18:15:24.786025 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:24.786010    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d715a23-1279-4823-b164-ae6ab39023ac" containerName="cleanup"
Sep 11 18:15:24.786025 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:24.786026    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d715a23-1279-4823-b164-ae6ab39023ac" containerName="cleanup"
Sep 11 18:15:24.786125 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:24.786043    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c41dc829-160a-499b-aa18-2eae6f1c4ed3" containerName="cleanup"
Sep 11 18:15:24.786125 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:24.786049    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c41dc829-160a-499b-aa18-2eae6f1c4ed3" containerName="cleanup"
Sep 11 18:15:24.786125 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:24.786116    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c41dc829-160a-499b-aa18-2eae6f1c4ed3" containerName="cleanup"
Sep 11 18:15:24.786283 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:24.786128    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d715a23-1279-4823-b164-ae6ab39023ac" containerName="cleanup"
Sep 11 18:15:24.789219 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:24.789201    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b54eb6-7krz6"
Sep 11 18:15:24.791418 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:24.791396    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 18:15:24.791532 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:24.791501    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 18:15:24.798951 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:24.798924    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b54eb6-7krz6"]
Sep 11 18:15:24.938350 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:24.938315    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11514d3d-c2fb-42e6-8c5e-5f18df8de5c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b54eb6-7krz6\" (UID: \"11514d3d-c2fb-42e6-8c5e-5f18df8de5c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b54eb6-7krz6"
Sep 11 18:15:25.039006 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:25.038913    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11514d3d-c2fb-42e6-8c5e-5f18df8de5c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b54eb6-7krz6\" (UID: \"11514d3d-c2fb-42e6-8c5e-5f18df8de5c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b54eb6-7krz6"
Sep 11 18:15:25.039613 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:25.039592    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11514d3d-c2fb-42e6-8c5e-5f18df8de5c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b54eb6-7krz6\" (UID: \"11514d3d-c2fb-42e6-8c5e-5f18df8de5c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b54eb6-7krz6"
Sep 11 18:15:25.100367 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:25.100334    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b54eb6-7krz6"
Sep 11 18:15:25.380852 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:25.380824    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b54eb6-7krz6"]
Sep 11 18:15:25.383185 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:15:25.383154    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11514d3d_c2fb_42e6_8c5e_5f18df8de5c1.slice/crio-7a04f22fbc335eefcb636add27494b935011a9641c3445ea7d4f2a05fb36e9ea WatchSource:0}: Error finding container 7a04f22fbc335eefcb636add27494b935011a9641c3445ea7d4f2a05fb36e9ea: Status 404 returned error can't find the container with id 7a04f22fbc335eefcb636add27494b935011a9641c3445ea7d4f2a05fb36e9ea
Sep 11 18:15:25.568584 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:25.568548    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 18:15:25.568749 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:25.568605    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr" podUID="fb7a44ea-e4cb-44d7-9162-9a34f79af06c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 18:15:25.889156 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:25.889117    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b54eb6-7krz6" event={"ID":"11514d3d-c2fb-42e6-8c5e-5f18df8de5c1","Type":"ContainerStarted","Data":"e9621fbafe7bcb79cf2f9ef86e78235817eddb05e16e7411f63b0aa8b9ef11aa"}
Sep 11 18:15:25.889333 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:25.889170    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b54eb6-7krz6" event={"ID":"11514d3d-c2fb-42e6-8c5e-5f18df8de5c1","Type":"ContainerStarted","Data":"7a04f22fbc335eefcb636add27494b935011a9641c3445ea7d4f2a05fb36e9ea"}
Sep 11 18:15:25.903321 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:25.903072    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b54eb6-7krz6" podStartSLOduration=1.9030529120000002 podStartE2EDuration="1.903052912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:15:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:15:25.902831061 +0000 UTC m=+1818.828782808" watchObservedRunningTime="2026-09-11 18:15:25.903052912 +0000 UTC m=+1818.829004658"
Sep 11 18:15:26.895961 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:26.895930    2579 generic.go:356] "Generic (PLEG): container finished" podID="11514d3d-c2fb-42e6-8c5e-5f18df8de5c1" containerID="e9621fbafe7bcb79cf2f9ef86e78235817eddb05e16e7411f63b0aa8b9ef11aa" exitCode=0
Sep 11 18:15:26.896318 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:26.896021    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b54eb6-7krz6" event={"ID":"11514d3d-c2fb-42e6-8c5e-5f18df8de5c1","Type":"ContainerDied","Data":"e9621fbafe7bcb79cf2f9ef86e78235817eddb05e16e7411f63b0aa8b9ef11aa"}
Sep 11 18:15:28.036369 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:28.036339    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b54eb6-7krz6"
Sep 11 18:15:28.069947 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:28.069912    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11514d3d-c2fb-42e6-8c5e-5f18df8de5c1-maas-api-service-ca\") pod \"11514d3d-c2fb-42e6-8c5e-5f18df8de5c1\" (UID: \"11514d3d-c2fb-42e6-8c5e-5f18df8de5c1\") "
Sep 11 18:15:28.070382 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:28.070351    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11514d3d-c2fb-42e6-8c5e-5f18df8de5c1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "11514d3d-c2fb-42e6-8c5e-5f18df8de5c1" (UID: "11514d3d-c2fb-42e6-8c5e-5f18df8de5c1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:15:28.171857 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:28.171751    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11514d3d-c2fb-42e6-8c5e-5f18df8de5c1-maas-api-service-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:15:28.909413 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:28.909372    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b54eb6-7krz6" event={"ID":"11514d3d-c2fb-42e6-8c5e-5f18df8de5c1","Type":"ContainerDied","Data":"7a04f22fbc335eefcb636add27494b935011a9641c3445ea7d4f2a05fb36e9ea"}
Sep 11 18:15:28.909582 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:28.909425    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a04f22fbc335eefcb636add27494b935011a9641c3445ea7d4f2a05fb36e9ea"
Sep 11 18:15:28.909582 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:28.909392    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b54eb6-7krz6"
Sep 11 18:15:29.626040 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.626015    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:15:29.685121 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.685025    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-token\") pod \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") "
Sep 11 18:15:29.685280 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.685152    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-data\") pod \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") "
Sep 11 18:15:29.685280 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.685176    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-workload-socket\") pod \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") "
Sep 11 18:15:29.685280 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.685204    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-envoy\") pod \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") "
Sep 11 18:15:29.685280 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.685234    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istiod-ca-cert\") pod \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") "
Sep 11 18:15:29.685280 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.685267    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-credential-socket\") pod \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") "
Sep 11 18:15:29.685575 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.685290    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-workload-certs\") pod \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") "
Sep 11 18:15:29.685575 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.685352    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4d9t\" (UniqueName: \"kubernetes.io/projected/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-kube-api-access-s4d9t\") pod \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") "
Sep 11 18:15:29.685575 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.685441    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-podinfo\") pod \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\" (UID: \"fb7a44ea-e4cb-44d7-9162-9a34f79af06c\") "
Sep 11 18:15:29.685575 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.685474    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-data" (OuterVolumeSpecName: "istio-data") pod "fb7a44ea-e4cb-44d7-9162-9a34f79af06c" (UID: "fb7a44ea-e4cb-44d7-9162-9a34f79af06c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:15:29.685575 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.685488    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fb7a44ea-e4cb-44d7-9162-9a34f79af06c" (UID: "fb7a44ea-e4cb-44d7-9162-9a34f79af06c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:15:29.685883 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.685582    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fb7a44ea-e4cb-44d7-9162-9a34f79af06c" (UID: "fb7a44ea-e4cb-44d7-9162-9a34f79af06c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:15:29.685883 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.685729    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fb7a44ea-e4cb-44d7-9162-9a34f79af06c" (UID: "fb7a44ea-e4cb-44d7-9162-9a34f79af06c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:15:29.685883 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.685770    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fb7a44ea-e4cb-44d7-9162-9a34f79af06c" (UID: "fb7a44ea-e4cb-44d7-9162-9a34f79af06c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:15:29.685992 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.685886    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-data\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:15:29.685992 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.685907    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-workload-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:15:29.685992 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.685922    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istiod-ca-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:15:29.685992 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.685936    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-credential-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:15:29.685992 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.685951    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-workload-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:15:29.687224 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.687201    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-token" (OuterVolumeSpecName: "istio-token") pod "fb7a44ea-e4cb-44d7-9162-9a34f79af06c" (UID: "fb7a44ea-e4cb-44d7-9162-9a34f79af06c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:15:29.687564 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.687543    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-kube-api-access-s4d9t" (OuterVolumeSpecName: "kube-api-access-s4d9t") pod "fb7a44ea-e4cb-44d7-9162-9a34f79af06c" (UID: "fb7a44ea-e4cb-44d7-9162-9a34f79af06c"). InnerVolumeSpecName "kube-api-access-s4d9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:15:29.687716 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.687653    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fb7a44ea-e4cb-44d7-9162-9a34f79af06c" (UID: "fb7a44ea-e4cb-44d7-9162-9a34f79af06c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:15:29.687834 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.687729    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fb7a44ea-e4cb-44d7-9162-9a34f79af06c" (UID: "fb7a44ea-e4cb-44d7-9162-9a34f79af06c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:15:29.787187 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.787155    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4d9t\" (UniqueName: \"kubernetes.io/projected/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-kube-api-access-s4d9t\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:15:29.787187 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.787182    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-podinfo\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:15:29.787187 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.787191    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-token\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:15:29.787386 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.787200    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb7a44ea-e4cb-44d7-9162-9a34f79af06c-istio-envoy\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:15:29.916316 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.916282    2579 generic.go:356] "Generic (PLEG): container finished" podID="fb7a44ea-e4cb-44d7-9162-9a34f79af06c" containerID="ed778336dae0feaaeb54501bb04b70b89a7bddaf84da74b498918eee21f0d640" exitCode=0
Sep 11 18:15:29.916477 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.916330    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"
Sep 11 18:15:29.916477 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.916332    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr" event={"ID":"fb7a44ea-e4cb-44d7-9162-9a34f79af06c","Type":"ContainerDied","Data":"ed778336dae0feaaeb54501bb04b70b89a7bddaf84da74b498918eee21f0d640"}
Sep 11 18:15:29.916477 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.916388    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr" event={"ID":"fb7a44ea-e4cb-44d7-9162-9a34f79af06c","Type":"ContainerDied","Data":"6000a56c119524a41fce1b4a64b27ab67184a4e9b70cba5f6a24c5c6c76d11bd"}
Sep 11 18:15:29.916477 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.916418    2579 scope.go:117] "RemoveContainer" containerID="ed778336dae0feaaeb54501bb04b70b89a7bddaf84da74b498918eee21f0d640"
Sep 11 18:15:29.926199 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.926183    2579 scope.go:117] "RemoveContainer" containerID="1a50935d6ef2346a12b2d0a16c473e2339e7ffcabd7710c420f44465c629e37b"
Sep 11 18:15:29.934293 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.934275    2579 scope.go:117] "RemoveContainer" containerID="ed778336dae0feaaeb54501bb04b70b89a7bddaf84da74b498918eee21f0d640"
Sep 11 18:15:29.934619 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:15:29.934595    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed778336dae0feaaeb54501bb04b70b89a7bddaf84da74b498918eee21f0d640\": container with ID starting with ed778336dae0feaaeb54501bb04b70b89a7bddaf84da74b498918eee21f0d640 not found: ID does not exist" containerID="ed778336dae0feaaeb54501bb04b70b89a7bddaf84da74b498918eee21f0d640"
Sep 11 18:15:29.934688 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.934632    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed778336dae0feaaeb54501bb04b70b89a7bddaf84da74b498918eee21f0d640"} err="failed to get container status \"ed778336dae0feaaeb54501bb04b70b89a7bddaf84da74b498918eee21f0d640\": rpc error: code = NotFound desc = could not find container \"ed778336dae0feaaeb54501bb04b70b89a7bddaf84da74b498918eee21f0d640\": container with ID starting with ed778336dae0feaaeb54501bb04b70b89a7bddaf84da74b498918eee21f0d640 not found: ID does not exist"
Sep 11 18:15:29.934688 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.934656    2579 scope.go:117] "RemoveContainer" containerID="1a50935d6ef2346a12b2d0a16c473e2339e7ffcabd7710c420f44465c629e37b"
Sep 11 18:15:29.935308 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:15:29.935197    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a50935d6ef2346a12b2d0a16c473e2339e7ffcabd7710c420f44465c629e37b\": container with ID starting with 1a50935d6ef2346a12b2d0a16c473e2339e7ffcabd7710c420f44465c629e37b not found: ID does not exist" containerID="1a50935d6ef2346a12b2d0a16c473e2339e7ffcabd7710c420f44465c629e37b"
Sep 11 18:15:29.935416 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.935282    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a50935d6ef2346a12b2d0a16c473e2339e7ffcabd7710c420f44465c629e37b"} err="failed to get container status \"1a50935d6ef2346a12b2d0a16c473e2339e7ffcabd7710c420f44465c629e37b\": rpc error: code = NotFound desc = could not find container \"1a50935d6ef2346a12b2d0a16c473e2339e7ffcabd7710c420f44465c629e37b\": container with ID starting with 1a50935d6ef2346a12b2d0a16c473e2339e7ffcabd7710c420f44465c629e37b not found: ID does not exist"
Sep 11 18:15:29.937266 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.937244    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"]
Sep 11 18:15:29.943445 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:29.943425    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr"]
Sep 11 18:15:31.534332 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:31.534301    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb7a44ea-e4cb-44d7-9162-9a34f79af06c" path="/var/lib/kubelet/pods/fb7a44ea-e4cb-44d7-9162-9a34f79af06c/volumes"
Sep 11 18:15:35.306606 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:35.306568    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-b54eb6-29819175-2p5c2"]
Sep 11 18:15:35.308637 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:35.308615    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-b54eb6-29819175-2p5c2"]
Sep 11 18:15:35.522687 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:35.522654    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b54eb6-7krz6"]
Sep 11 18:15:35.525976 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:35.525950    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b54eb6-7krz6"]
Sep 11 18:15:35.534229 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:35.534203    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11514d3d-c2fb-42e6-8c5e-5f18df8de5c1" path="/var/lib/kubelet/pods/11514d3d-c2fb-42e6-8c5e-5f18df8de5c1/volumes"
Sep 11 18:15:35.534518 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:35.534505    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d715a23-1279-4823-b164-ae6ab39023ac" path="/var/lib/kubelet/pods/2d715a23-1279-4823-b164-ae6ab39023ac/volumes"
Sep 11 18:15:42.393662 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:42.393628    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"]
Sep 11 18:15:42.394296 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:42.393914    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6" podUID="addc00a0-02d5-4d5b-a872-a9f43465f7c4" containerName="istio-proxy" containerID="cri-o://fa192eae77a0c0cfd537e83841400edd3d13e4f9a7018dfbea767e407b58395c" gracePeriod=30
Sep 11 18:15:42.803389 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:42.803352    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-386935-ns9cm"]
Sep 11 18:15:42.803820 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:42.803806    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb7a44ea-e4cb-44d7-9162-9a34f79af06c" containerName="istio-proxy"
Sep 11 18:15:42.803872 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:42.803821    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb7a44ea-e4cb-44d7-9162-9a34f79af06c" containerName="istio-proxy"
Sep 11 18:15:42.803872 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:42.803845    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11514d3d-c2fb-42e6-8c5e-5f18df8de5c1" containerName="revoke-keys"
Sep 11 18:15:42.803872 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:42.803850    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="11514d3d-c2fb-42e6-8c5e-5f18df8de5c1" containerName="revoke-keys"
Sep 11 18:15:42.803974 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:42.803911    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb7a44ea-e4cb-44d7-9162-9a34f79af06c" containerName="istio-proxy"
Sep 11 18:15:42.803974 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:42.803920    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb7a44ea-e4cb-44d7-9162-9a34f79af06c" containerName="istio-proxy"
Sep 11 18:15:42.803974 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:42.803932    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="11514d3d-c2fb-42e6-8c5e-5f18df8de5c1" containerName="revoke-keys"
Sep 11 18:15:42.806934 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:42.806918    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-386935-ns9cm"
Sep 11 18:15:42.809201 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:42.809178    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 18:15:42.809425 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:42.809408    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 18:15:42.815402 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:42.815371    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-386935-ns9cm"]
Sep 11 18:15:42.929316 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:42.929280    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ab5132-4bbd-4e31-9a03-08c38f019a30-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-386935-ns9cm\" (UID: \"28ab5132-4bbd-4e31-9a03-08c38f019a30\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-386935-ns9cm"
Sep 11 18:15:43.030065 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:43.030031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ab5132-4bbd-4e31-9a03-08c38f019a30-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-386935-ns9cm\" (UID: \"28ab5132-4bbd-4e31-9a03-08c38f019a30\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-386935-ns9cm"
Sep 11 18:15:43.030911 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:43.030886    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ab5132-4bbd-4e31-9a03-08c38f019a30-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-386935-ns9cm\" (UID: \"28ab5132-4bbd-4e31-9a03-08c38f019a30\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-386935-ns9cm"
Sep 11 18:15:43.119392 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:43.119291    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-386935-ns9cm"
Sep 11 18:15:43.400923 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:43.400895    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-386935-ns9cm"]
Sep 11 18:15:43.403011 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:15:43.402971    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28ab5132_4bbd_4e31_9a03_08c38f019a30.slice/crio-580cdf6b1da29b9043333117a9cbd602fb2a043351bd7dd3a1457bad3f99fa64 WatchSource:0}: Error finding container 580cdf6b1da29b9043333117a9cbd602fb2a043351bd7dd3a1457bad3f99fa64: Status 404 returned error can't find the container with id 580cdf6b1da29b9043333117a9cbd602fb2a043351bd7dd3a1457bad3f99fa64
Sep 11 18:15:43.997851 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:43.997803    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-386935-ns9cm" event={"ID":"28ab5132-4bbd-4e31-9a03-08c38f019a30","Type":"ContainerStarted","Data":"5c993fb51c959624ef7a40b51e3afba92c42398e6a03e8610299e05b373644b0"}
Sep 11 18:15:43.998028 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:43.997874    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-386935-ns9cm" event={"ID":"28ab5132-4bbd-4e31-9a03-08c38f019a30","Type":"ContainerStarted","Data":"580cdf6b1da29b9043333117a9cbd602fb2a043351bd7dd3a1457bad3f99fa64"}
Sep 11 18:15:44.016521 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:44.016471    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-386935-ns9cm" podStartSLOduration=2.016455753 podStartE2EDuration="2.016455753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:15:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:15:44.014150711 +0000 UTC m=+1836.940102456" watchObservedRunningTime="2026-09-11 18:15:44.016455753 +0000 UTC m=+1836.942407499"
Sep 11 18:15:45.005148 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:45.005114    2579 generic.go:356] "Generic (PLEG): container finished" podID="28ab5132-4bbd-4e31-9a03-08c38f019a30" containerID="5c993fb51c959624ef7a40b51e3afba92c42398e6a03e8610299e05b373644b0" exitCode=0
Sep 11 18:15:45.005592 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:45.005203    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-386935-ns9cm" event={"ID":"28ab5132-4bbd-4e31-9a03-08c38f019a30","Type":"ContainerDied","Data":"5c993fb51c959624ef7a40b51e3afba92c42398e6a03e8610299e05b373644b0"}
Sep 11 18:15:46.148797 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:46.148775    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-386935-ns9cm"
Sep 11 18:15:46.267922 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:46.267832    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ab5132-4bbd-4e31-9a03-08c38f019a30-maas-api-service-ca\") pod \"28ab5132-4bbd-4e31-9a03-08c38f019a30\" (UID: \"28ab5132-4bbd-4e31-9a03-08c38f019a30\") "
Sep 11 18:15:46.268205 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:46.268183    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28ab5132-4bbd-4e31-9a03-08c38f019a30-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "28ab5132-4bbd-4e31-9a03-08c38f019a30" (UID: "28ab5132-4bbd-4e31-9a03-08c38f019a30"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:15:46.369654 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:46.369622    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ab5132-4bbd-4e31-9a03-08c38f019a30-maas-api-service-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:15:47.017620 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.017587    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-386935-ns9cm"
Sep 11 18:15:47.017809 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.017619    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-386935-ns9cm" event={"ID":"28ab5132-4bbd-4e31-9a03-08c38f019a30","Type":"ContainerDied","Data":"580cdf6b1da29b9043333117a9cbd602fb2a043351bd7dd3a1457bad3f99fa64"}
Sep 11 18:15:47.017809 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.017668    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="580cdf6b1da29b9043333117a9cbd602fb2a043351bd7dd3a1457bad3f99fa64"
Sep 11 18:15:47.090473 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.090437    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 18:15:47.090645 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.090494    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6" podUID="addc00a0-02d5-4d5b-a872-a9f43465f7c4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 18:15:47.654196 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.654168    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:15:47.784168 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.784135    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-envoy\") pod \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") "
Sep 11 18:15:47.784362 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.784178    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-podinfo\") pod \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") "
Sep 11 18:15:47.784362 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.784211    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-credential-socket\") pod \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") "
Sep 11 18:15:47.784362 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.784239    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-workload-socket\") pod \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") "
Sep 11 18:15:47.784362 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.784267    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istiod-ca-cert\") pod \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") "
Sep 11 18:15:47.784362 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.784342    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cr9d\" (UniqueName: \"kubernetes.io/projected/addc00a0-02d5-4d5b-a872-a9f43465f7c4-kube-api-access-5cr9d\") pod \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") "
Sep 11 18:15:47.784661 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.784391    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-data\") pod \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") "
Sep 11 18:15:47.784661 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.784465    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-token\") pod \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") "
Sep 11 18:15:47.784661 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.784542    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-workload-certs\") pod \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\" (UID: \"addc00a0-02d5-4d5b-a872-a9f43465f7c4\") "
Sep 11 18:15:47.784661 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.784549    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "addc00a0-02d5-4d5b-a872-a9f43465f7c4" (UID: "addc00a0-02d5-4d5b-a872-a9f43465f7c4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:15:47.784661 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.784593    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "addc00a0-02d5-4d5b-a872-a9f43465f7c4" (UID: "addc00a0-02d5-4d5b-a872-a9f43465f7c4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:15:47.784971 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.784864    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-data" (OuterVolumeSpecName: "istio-data") pod "addc00a0-02d5-4d5b-a872-a9f43465f7c4" (UID: "addc00a0-02d5-4d5b-a872-a9f43465f7c4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:15:47.784971 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.784897    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "addc00a0-02d5-4d5b-a872-a9f43465f7c4" (UID: "addc00a0-02d5-4d5b-a872-a9f43465f7c4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:15:47.785081 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.784976    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-data\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:15:47.785081 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.784993    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-credential-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:15:47.785081 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.785007    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-workload-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:15:47.785081 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.785052    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istiod-ca-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:15:47.785081 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.785073    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "addc00a0-02d5-4d5b-a872-a9f43465f7c4" (UID: "addc00a0-02d5-4d5b-a872-a9f43465f7c4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:15:47.786434 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.786407    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "addc00a0-02d5-4d5b-a872-a9f43465f7c4" (UID: "addc00a0-02d5-4d5b-a872-a9f43465f7c4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:15:47.786585 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.786564    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "addc00a0-02d5-4d5b-a872-a9f43465f7c4" (UID: "addc00a0-02d5-4d5b-a872-a9f43465f7c4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:15:47.786906 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.786888    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/addc00a0-02d5-4d5b-a872-a9f43465f7c4-kube-api-access-5cr9d" (OuterVolumeSpecName: "kube-api-access-5cr9d") pod "addc00a0-02d5-4d5b-a872-a9f43465f7c4" (UID: "addc00a0-02d5-4d5b-a872-a9f43465f7c4"). InnerVolumeSpecName "kube-api-access-5cr9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:15:47.786970 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.786908    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-token" (OuterVolumeSpecName: "istio-token") pod "addc00a0-02d5-4d5b-a872-a9f43465f7c4" (UID: "addc00a0-02d5-4d5b-a872-a9f43465f7c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:15:47.886458 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.886407    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cr9d\" (UniqueName: \"kubernetes.io/projected/addc00a0-02d5-4d5b-a872-a9f43465f7c4-kube-api-access-5cr9d\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:15:47.886458 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.886457    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-token\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:15:47.886458 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.886470    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-workload-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:15:47.886700 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.886478    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-envoy\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:15:47.886700 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:47.886487    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/addc00a0-02d5-4d5b-a872-a9f43465f7c4-istio-podinfo\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:15:48.025182 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:48.025143    2579 generic.go:356] "Generic (PLEG): container finished" podID="addc00a0-02d5-4d5b-a872-a9f43465f7c4" containerID="fa192eae77a0c0cfd537e83841400edd3d13e4f9a7018dfbea767e407b58395c" exitCode=0
Sep 11 18:15:48.025334 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:48.025206    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"
Sep 11 18:15:48.025334 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:48.025223    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6" event={"ID":"addc00a0-02d5-4d5b-a872-a9f43465f7c4","Type":"ContainerDied","Data":"fa192eae77a0c0cfd537e83841400edd3d13e4f9a7018dfbea767e407b58395c"}
Sep 11 18:15:48.025334 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:48.025304    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6" event={"ID":"addc00a0-02d5-4d5b-a872-a9f43465f7c4","Type":"ContainerDied","Data":"6b6ad7628eb6d407d5fc0100e2b2b722f965acfb0559df0d554f86d3aedd220f"}
Sep 11 18:15:48.025334 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:48.025332    2579 scope.go:117] "RemoveContainer" containerID="fa192eae77a0c0cfd537e83841400edd3d13e4f9a7018dfbea767e407b58395c"
Sep 11 18:15:48.035363 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:48.035332    2579 scope.go:117] "RemoveContainer" containerID="22ddb0e60874cfda6589ffaf41d9ffbaa86edd711f653406fc3a1c706ba85c3a"
Sep 11 18:15:48.043980 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:48.043958    2579 scope.go:117] "RemoveContainer" containerID="fa192eae77a0c0cfd537e83841400edd3d13e4f9a7018dfbea767e407b58395c"
Sep 11 18:15:48.044275 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:15:48.044253    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa192eae77a0c0cfd537e83841400edd3d13e4f9a7018dfbea767e407b58395c\": container with ID starting with fa192eae77a0c0cfd537e83841400edd3d13e4f9a7018dfbea767e407b58395c not found: ID does not exist" containerID="fa192eae77a0c0cfd537e83841400edd3d13e4f9a7018dfbea767e407b58395c"
Sep 11 18:15:48.044327 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:48.044286    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa192eae77a0c0cfd537e83841400edd3d13e4f9a7018dfbea767e407b58395c"} err="failed to get container status \"fa192eae77a0c0cfd537e83841400edd3d13e4f9a7018dfbea767e407b58395c\": rpc error: code = NotFound desc = could not find container \"fa192eae77a0c0cfd537e83841400edd3d13e4f9a7018dfbea767e407b58395c\": container with ID starting with fa192eae77a0c0cfd537e83841400edd3d13e4f9a7018dfbea767e407b58395c not found: ID does not exist"
Sep 11 18:15:48.044327 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:48.044302    2579 scope.go:117] "RemoveContainer" containerID="22ddb0e60874cfda6589ffaf41d9ffbaa86edd711f653406fc3a1c706ba85c3a"
Sep 11 18:15:48.044547 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:15:48.044530    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22ddb0e60874cfda6589ffaf41d9ffbaa86edd711f653406fc3a1c706ba85c3a\": container with ID starting with 22ddb0e60874cfda6589ffaf41d9ffbaa86edd711f653406fc3a1c706ba85c3a not found: ID does not exist" containerID="22ddb0e60874cfda6589ffaf41d9ffbaa86edd711f653406fc3a1c706ba85c3a"
Sep 11 18:15:48.044595 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:48.044550    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22ddb0e60874cfda6589ffaf41d9ffbaa86edd711f653406fc3a1c706ba85c3a"} err="failed to get container status \"22ddb0e60874cfda6589ffaf41d9ffbaa86edd711f653406fc3a1c706ba85c3a\": rpc error: code = NotFound desc = could not find container \"22ddb0e60874cfda6589ffaf41d9ffbaa86edd711f653406fc3a1c706ba85c3a\": container with ID starting with 22ddb0e60874cfda6589ffaf41d9ffbaa86edd711f653406fc3a1c706ba85c3a not found: ID does not exist"
Sep 11 18:15:48.048827 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:48.048799    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"]
Sep 11 18:15:48.052500 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:48.052476    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6"]
Sep 11 18:15:49.534478 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:49.534443    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="addc00a0-02d5-4d5b-a872-a9f43465f7c4" path="/var/lib/kubelet/pods/addc00a0-02d5-4d5b-a872-a9f43465f7c4/volumes"
Sep 11 18:15:53.795929 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:53.795890    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-386935-ns9cm"]
Sep 11 18:15:53.799251 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:53.799223    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-386935-ns9cm"]
Sep 11 18:15:55.534177 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:15:55.534143    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28ab5132-4bbd-4e31-9a03-08c38f019a30" path="/var/lib/kubelet/pods/28ab5132-4bbd-4e31-9a03-08c38f019a30/volumes"
Sep 11 18:16:00.519566 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:00.519526    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"]
Sep 11 18:16:00.520064 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:00.519774    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf" podUID="915d571b-b41a-4bb3-8b66-5424153832ad" containerName="istio-proxy" containerID="cri-o://cd1cf17d6a7629b2d2c45e412dd814ee588d3ae069fd0ffef46eb2d2b3b3f285" gracePeriod=30
Sep 11 18:16:00.913100 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:00.913008    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3ebea5-8h5gv"]
Sep 11 18:16:00.913540 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:00.913522    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="addc00a0-02d5-4d5b-a872-a9f43465f7c4" containerName="istio-proxy"
Sep 11 18:16:00.913640 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:00.913542    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="addc00a0-02d5-4d5b-a872-a9f43465f7c4" containerName="istio-proxy"
Sep 11 18:16:00.913640 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:00.913559    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="addc00a0-02d5-4d5b-a872-a9f43465f7c4" containerName="istio-proxy"
Sep 11 18:16:00.913640 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:00.913567    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="addc00a0-02d5-4d5b-a872-a9f43465f7c4" containerName="istio-proxy"
Sep 11 18:16:00.913640 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:00.913597    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28ab5132-4bbd-4e31-9a03-08c38f019a30" containerName="revoke-keys"
Sep 11 18:16:00.913640 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:00.913606    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="28ab5132-4bbd-4e31-9a03-08c38f019a30" containerName="revoke-keys"
Sep 11 18:16:00.913640 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:00.913635    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb7a44ea-e4cb-44d7-9162-9a34f79af06c" containerName="istio-proxy"
Sep 11 18:16:00.913986 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:00.913643    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb7a44ea-e4cb-44d7-9162-9a34f79af06c" containerName="istio-proxy"
Sep 11 18:16:00.913986 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:00.913751    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="addc00a0-02d5-4d5b-a872-a9f43465f7c4" containerName="istio-proxy"
Sep 11 18:16:00.913986 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:00.913783    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="addc00a0-02d5-4d5b-a872-a9f43465f7c4" containerName="istio-proxy"
Sep 11 18:16:00.913986 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:00.913795    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="28ab5132-4bbd-4e31-9a03-08c38f019a30" containerName="revoke-keys"
Sep 11 18:16:00.918495 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:00.918475    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3ebea5-8h5gv"
Sep 11 18:16:00.920940 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:00.920912    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 18:16:00.921074 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:00.920912    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 18:16:00.925178 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:00.925153    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3ebea5-8h5gv"]
Sep 11 18:16:01.009955 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:01.009913    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d5b23c6-db2f-40db-bef9-b12194fbd9b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-3ebea5-8h5gv\" (UID: \"4d5b23c6-db2f-40db-bef9-b12194fbd9b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3ebea5-8h5gv"
Sep 11 18:16:01.110525 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:01.110496    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d5b23c6-db2f-40db-bef9-b12194fbd9b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-3ebea5-8h5gv\" (UID: \"4d5b23c6-db2f-40db-bef9-b12194fbd9b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3ebea5-8h5gv"
Sep 11 18:16:01.111129 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:01.111112    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d5b23c6-db2f-40db-bef9-b12194fbd9b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-3ebea5-8h5gv\" (UID: \"4d5b23c6-db2f-40db-bef9-b12194fbd9b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3ebea5-8h5gv"
Sep 11 18:16:01.230125 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:01.230032    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3ebea5-8h5gv"
Sep 11 18:16:01.502037 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:01.502011    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3ebea5-8h5gv"]
Sep 11 18:16:01.503924 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:16:01.503894    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5b23c6_db2f_40db_bef9_b12194fbd9b0.slice/crio-513cd5fe85984eb1effafa08d917e3243737006052cb3ed5a5b55a976f9fd81a WatchSource:0}: Error finding container 513cd5fe85984eb1effafa08d917e3243737006052cb3ed5a5b55a976f9fd81a: Status 404 returned error can't find the container with id 513cd5fe85984eb1effafa08d917e3243737006052cb3ed5a5b55a976f9fd81a
Sep 11 18:16:02.113281 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:02.113188    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3ebea5-8h5gv" event={"ID":"4d5b23c6-db2f-40db-bef9-b12194fbd9b0","Type":"ContainerStarted","Data":"cda3bd15e698bf62185f1877accf78794177638a729c5d39b4d1ce62e120e020"}
Sep 11 18:16:02.113281 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:02.113249    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3ebea5-8h5gv" event={"ID":"4d5b23c6-db2f-40db-bef9-b12194fbd9b0","Type":"ContainerStarted","Data":"513cd5fe85984eb1effafa08d917e3243737006052cb3ed5a5b55a976f9fd81a"}
Sep 11 18:16:03.123630 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:03.123597    2579 generic.go:356] "Generic (PLEG): container finished" podID="4d5b23c6-db2f-40db-bef9-b12194fbd9b0" containerID="cda3bd15e698bf62185f1877accf78794177638a729c5d39b4d1ce62e120e020" exitCode=0
Sep 11 18:16:03.124078 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:03.123667    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3ebea5-8h5gv" event={"ID":"4d5b23c6-db2f-40db-bef9-b12194fbd9b0","Type":"ContainerDied","Data":"cda3bd15e698bf62185f1877accf78794177638a729c5d39b4d1ce62e120e020"}
Sep 11 18:16:03.261140 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:03.261117    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3ebea5-8h5gv"
Sep 11 18:16:03.328611 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:03.328574    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d5b23c6-db2f-40db-bef9-b12194fbd9b0-maas-api-service-ca\") pod \"4d5b23c6-db2f-40db-bef9-b12194fbd9b0\" (UID: \"4d5b23c6-db2f-40db-bef9-b12194fbd9b0\") "
Sep 11 18:16:03.328958 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:03.328932    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d5b23c6-db2f-40db-bef9-b12194fbd9b0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4d5b23c6-db2f-40db-bef9-b12194fbd9b0" (UID: "4d5b23c6-db2f-40db-bef9-b12194fbd9b0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:16:03.429717 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:03.429639    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d5b23c6-db2f-40db-bef9-b12194fbd9b0-maas-api-service-ca\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:16:04.130819 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:04.130792    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3ebea5-8h5gv"
Sep 11 18:16:04.131293 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:04.130818    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3ebea5-8h5gv" event={"ID":"4d5b23c6-db2f-40db-bef9-b12194fbd9b0","Type":"ContainerDied","Data":"513cd5fe85984eb1effafa08d917e3243737006052cb3ed5a5b55a976f9fd81a"}
Sep 11 18:16:04.131293 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:04.130892    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="513cd5fe85984eb1effafa08d917e3243737006052cb3ed5a5b55a976f9fd81a"
Sep 11 18:16:05.782355 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.782331    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:16:05.853504 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.853406    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-workload-socket\") pod \"915d571b-b41a-4bb3-8b66-5424153832ad\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") "
Sep 11 18:16:05.853504 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.853462    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/915d571b-b41a-4bb3-8b66-5424153832ad-istiod-ca-cert\") pod \"915d571b-b41a-4bb3-8b66-5424153832ad\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") "
Sep 11 18:16:05.853728 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.853527    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-workload-certs\") pod \"915d571b-b41a-4bb3-8b66-5424153832ad\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") "
Sep 11 18:16:05.853728 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.853565    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-istio-data\") pod \"915d571b-b41a-4bb3-8b66-5424153832ad\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") "
Sep 11 18:16:05.853728 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.853648    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mssmg\" (UniqueName: \"kubernetes.io/projected/915d571b-b41a-4bb3-8b66-5424153832ad-kube-api-access-mssmg\") pod \"915d571b-b41a-4bb3-8b66-5424153832ad\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") "
Sep 11 18:16:05.853728 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.853676    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/915d571b-b41a-4bb3-8b66-5424153832ad-istio-token\") pod \"915d571b-b41a-4bb3-8b66-5424153832ad\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") "
Sep 11 18:16:05.853728 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.853705    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-credential-socket\") pod \"915d571b-b41a-4bb3-8b66-5424153832ad\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") "
Sep 11 18:16:05.854046 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.853737    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/915d571b-b41a-4bb3-8b66-5424153832ad-istio-podinfo\") pod \"915d571b-b41a-4bb3-8b66-5424153832ad\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") "
Sep 11 18:16:05.854046 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.853797    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "915d571b-b41a-4bb3-8b66-5424153832ad" (UID: "915d571b-b41a-4bb3-8b66-5424153832ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:16:05.854046 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.853826    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-istio-envoy\") pod \"915d571b-b41a-4bb3-8b66-5424153832ad\" (UID: \"915d571b-b41a-4bb3-8b66-5424153832ad\") "
Sep 11 18:16:05.854046 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.853954    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "915d571b-b41a-4bb3-8b66-5424153832ad" (UID: "915d571b-b41a-4bb3-8b66-5424153832ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:16:05.854046 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.853971    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/915d571b-b41a-4bb3-8b66-5424153832ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "915d571b-b41a-4bb3-8b66-5424153832ad" (UID: "915d571b-b41a-4bb3-8b66-5424153832ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:16:05.854046 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.853961    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "915d571b-b41a-4bb3-8b66-5424153832ad" (UID: "915d571b-b41a-4bb3-8b66-5424153832ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:16:05.854350 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.854148    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-workload-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:16:05.854350 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.854171    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/915d571b-b41a-4bb3-8b66-5424153832ad-istiod-ca-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:16:05.854350 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.854186    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-workload-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:16:05.854350 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.854198    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-istio-data\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:16:05.854350 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.854275    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "915d571b-b41a-4bb3-8b66-5424153832ad" (UID: "915d571b-b41a-4bb3-8b66-5424153832ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:16:05.856002 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.855979    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/915d571b-b41a-4bb3-8b66-5424153832ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "915d571b-b41a-4bb3-8b66-5424153832ad" (UID: "915d571b-b41a-4bb3-8b66-5424153832ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:16:05.856112 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.856048    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/915d571b-b41a-4bb3-8b66-5424153832ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "915d571b-b41a-4bb3-8b66-5424153832ad" (UID: "915d571b-b41a-4bb3-8b66-5424153832ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:16:05.856277 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.856261    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "915d571b-b41a-4bb3-8b66-5424153832ad" (UID: "915d571b-b41a-4bb3-8b66-5424153832ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:16:05.856338 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.856290    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/915d571b-b41a-4bb3-8b66-5424153832ad-kube-api-access-mssmg" (OuterVolumeSpecName: "kube-api-access-mssmg") pod "915d571b-b41a-4bb3-8b66-5424153832ad" (UID: "915d571b-b41a-4bb3-8b66-5424153832ad"). InnerVolumeSpecName "kube-api-access-mssmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:16:05.955146 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.955111    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mssmg\" (UniqueName: \"kubernetes.io/projected/915d571b-b41a-4bb3-8b66-5424153832ad-kube-api-access-mssmg\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:16:05.955146 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.955140    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/915d571b-b41a-4bb3-8b66-5424153832ad-istio-token\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:16:05.955146 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.955150    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-credential-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:16:05.955146 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.955159    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/915d571b-b41a-4bb3-8b66-5424153832ad-istio-podinfo\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:16:05.955427 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:05.955169    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/915d571b-b41a-4bb3-8b66-5424153832ad-istio-envoy\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:16:06.144820 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:06.144713    2579 generic.go:356] "Generic (PLEG): container finished" podID="915d571b-b41a-4bb3-8b66-5424153832ad" containerID="cd1cf17d6a7629b2d2c45e412dd814ee588d3ae069fd0ffef46eb2d2b3b3f285" exitCode=0
Sep 11 18:16:06.144820 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:06.144778    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"
Sep 11 18:16:06.144820 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:06.144796    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf" event={"ID":"915d571b-b41a-4bb3-8b66-5424153832ad","Type":"ContainerDied","Data":"cd1cf17d6a7629b2d2c45e412dd814ee588d3ae069fd0ffef46eb2d2b3b3f285"}
Sep 11 18:16:06.145051 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:06.144860    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf" event={"ID":"915d571b-b41a-4bb3-8b66-5424153832ad","Type":"ContainerDied","Data":"cdebc5322ae5f0c2f9bb5a8b5455cd67841d0265202c4fad31ef1133b02a7b83"}
Sep 11 18:16:06.145051 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:06.144884    2579 scope.go:117] "RemoveContainer" containerID="cd1cf17d6a7629b2d2c45e412dd814ee588d3ae069fd0ffef46eb2d2b3b3f285"
Sep 11 18:16:06.155084 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:06.155065    2579 scope.go:117] "RemoveContainer" containerID="de1d174b6861c94ea50dbeb74218e5e34fbc771d587f48e90b78a28f83e90900"
Sep 11 18:16:06.163718 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:06.163699    2579 scope.go:117] "RemoveContainer" containerID="cd1cf17d6a7629b2d2c45e412dd814ee588d3ae069fd0ffef46eb2d2b3b3f285"
Sep 11 18:16:06.164009 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:16:06.163990    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd1cf17d6a7629b2d2c45e412dd814ee588d3ae069fd0ffef46eb2d2b3b3f285\": container with ID starting with cd1cf17d6a7629b2d2c45e412dd814ee588d3ae069fd0ffef46eb2d2b3b3f285 not found: ID does not exist" containerID="cd1cf17d6a7629b2d2c45e412dd814ee588d3ae069fd0ffef46eb2d2b3b3f285"
Sep 11 18:16:06.164105 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:06.164020    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd1cf17d6a7629b2d2c45e412dd814ee588d3ae069fd0ffef46eb2d2b3b3f285"} err="failed to get container status \"cd1cf17d6a7629b2d2c45e412dd814ee588d3ae069fd0ffef46eb2d2b3b3f285\": rpc error: code = NotFound desc = could not find container \"cd1cf17d6a7629b2d2c45e412dd814ee588d3ae069fd0ffef46eb2d2b3b3f285\": container with ID starting with cd1cf17d6a7629b2d2c45e412dd814ee588d3ae069fd0ffef46eb2d2b3b3f285 not found: ID does not exist"
Sep 11 18:16:06.164105 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:06.164044    2579 scope.go:117] "RemoveContainer" containerID="de1d174b6861c94ea50dbeb74218e5e34fbc771d587f48e90b78a28f83e90900"
Sep 11 18:16:06.164310 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:16:06.164288    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de1d174b6861c94ea50dbeb74218e5e34fbc771d587f48e90b78a28f83e90900\": container with ID starting with de1d174b6861c94ea50dbeb74218e5e34fbc771d587f48e90b78a28f83e90900 not found: ID does not exist" containerID="de1d174b6861c94ea50dbeb74218e5e34fbc771d587f48e90b78a28f83e90900"
Sep 11 18:16:06.164346 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:06.164317    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de1d174b6861c94ea50dbeb74218e5e34fbc771d587f48e90b78a28f83e90900"} err="failed to get container status \"de1d174b6861c94ea50dbeb74218e5e34fbc771d587f48e90b78a28f83e90900\": rpc error: code = NotFound desc = could not find container \"de1d174b6861c94ea50dbeb74218e5e34fbc771d587f48e90b78a28f83e90900\": container with ID starting with de1d174b6861c94ea50dbeb74218e5e34fbc771d587f48e90b78a28f83e90900 not found: ID does not exist"
Sep 11 18:16:06.167702 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:06.167677    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"]
Sep 11 18:16:06.174026 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:06.174006    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf"]
Sep 11 18:16:07.534506 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:07.534473    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="915d571b-b41a-4bb3-8b66-5424153832ad" path="/var/lib/kubelet/pods/915d571b-b41a-4bb3-8b66-5424153832ad/volumes"
Sep 11 18:16:07.953299 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:07.953206    2579 scope.go:117] "RemoveContainer" containerID="b0fa55abff983e46b9d049f5d3303b7a825a5417097bb414923a0c6004ceeab4"
Sep 11 18:16:11.834021 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:11.833985    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3ebea5-8h5gv"]
Sep 11 18:16:11.839597 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:11.839570    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3ebea5-8h5gv"]
Sep 11 18:16:13.533952 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:13.533920    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d5b23c6-db2f-40db-bef9-b12194fbd9b0" path="/var/lib/kubelet/pods/4d5b23c6-db2f-40db-bef9-b12194fbd9b0/volumes"
Sep 11 18:16:18.522753 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:18.522715    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"]
Sep 11 18:16:18.523183 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:18.523006    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2" podUID="2a17563d-5f90-4655-a937-d8537a3805f5" containerName="istio-proxy" containerID="cri-o://4687b3f51a7e64e248f51ee42b541de80df3f79be2d48fd5153c455ece0085e5" gracePeriod=30
Sep 11 18:16:19.992097 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:19.992058    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 18:16:19.992494 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:19.992127    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2" podUID="2a17563d-5f90-4655-a937-d8537a3805f5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 18:16:23.799035 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:23.798957    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:16:23.927195 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:23.927136    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-workload-certs\") pod \"2a17563d-5f90-4655-a937-d8537a3805f5\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") "
Sep 11 18:16:23.927404 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:23.927223    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a17563d-5f90-4655-a937-d8537a3805f5-istio-podinfo\") pod \"2a17563d-5f90-4655-a937-d8537a3805f5\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") "
Sep 11 18:16:23.927404 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:23.927256    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a17563d-5f90-4655-a937-d8537a3805f5-istio-token\") pod \"2a17563d-5f90-4655-a937-d8537a3805f5\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") "
Sep 11 18:16:23.927404 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:23.927282    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-istio-envoy\") pod \"2a17563d-5f90-4655-a937-d8537a3805f5\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") "
Sep 11 18:16:23.927404 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:23.927326    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-istio-data\") pod \"2a17563d-5f90-4655-a937-d8537a3805f5\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") "
Sep 11 18:16:23.927404 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:23.927371    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-workload-socket\") pod \"2a17563d-5f90-4655-a937-d8537a3805f5\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") "
Sep 11 18:16:23.927404 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:23.927401    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a17563d-5f90-4655-a937-d8537a3805f5-istiod-ca-cert\") pod \"2a17563d-5f90-4655-a937-d8537a3805f5\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") "
Sep 11 18:16:23.927788 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:23.927433    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-credential-socket\") pod \"2a17563d-5f90-4655-a937-d8537a3805f5\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") "
Sep 11 18:16:23.927788 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:23.927464    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2a17563d-5f90-4655-a937-d8537a3805f5" (UID: "2a17563d-5f90-4655-a937-d8537a3805f5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:16:23.927788 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:23.927482    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7skl\" (UniqueName: \"kubernetes.io/projected/2a17563d-5f90-4655-a937-d8537a3805f5-kube-api-access-z7skl\") pod \"2a17563d-5f90-4655-a937-d8537a3805f5\" (UID: \"2a17563d-5f90-4655-a937-d8537a3805f5\") "
Sep 11 18:16:23.927970 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:23.927814    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2a17563d-5f90-4655-a937-d8537a3805f5" (UID: "2a17563d-5f90-4655-a937-d8537a3805f5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:16:23.927970 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:23.927950    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-workload-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:16:23.928085 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:23.927970    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-workload-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:16:23.928149 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:23.928096    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a17563d-5f90-4655-a937-d8537a3805f5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2a17563d-5f90-4655-a937-d8537a3805f5" (UID: "2a17563d-5f90-4655-a937-d8537a3805f5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:16:23.928354 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:23.928330    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-istio-data" (OuterVolumeSpecName: "istio-data") pod "2a17563d-5f90-4655-a937-d8537a3805f5" (UID: "2a17563d-5f90-4655-a937-d8537a3805f5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:16:23.928438 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:23.928379    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2a17563d-5f90-4655-a937-d8537a3805f5" (UID: "2a17563d-5f90-4655-a937-d8537a3805f5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:16:23.930497 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:23.930462    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a17563d-5f90-4655-a937-d8537a3805f5-kube-api-access-z7skl" (OuterVolumeSpecName: "kube-api-access-z7skl") pod "2a17563d-5f90-4655-a937-d8537a3805f5" (UID: "2a17563d-5f90-4655-a937-d8537a3805f5"). InnerVolumeSpecName "kube-api-access-z7skl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:16:23.930793 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:23.930607    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2a17563d-5f90-4655-a937-d8537a3805f5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2a17563d-5f90-4655-a937-d8537a3805f5" (UID: "2a17563d-5f90-4655-a937-d8537a3805f5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:16:23.930793 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:23.930634    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a17563d-5f90-4655-a937-d8537a3805f5-istio-token" (OuterVolumeSpecName: "istio-token") pod "2a17563d-5f90-4655-a937-d8537a3805f5" (UID: "2a17563d-5f90-4655-a937-d8537a3805f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:16:23.930957 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:23.930802    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2a17563d-5f90-4655-a937-d8537a3805f5" (UID: "2a17563d-5f90-4655-a937-d8537a3805f5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:16:24.029406 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:24.029356    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-credential-socket\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:16:24.029406 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:24.029392    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7skl\" (UniqueName: \"kubernetes.io/projected/2a17563d-5f90-4655-a937-d8537a3805f5-kube-api-access-z7skl\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:16:24.029406 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:24.029402    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a17563d-5f90-4655-a937-d8537a3805f5-istio-podinfo\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:16:24.029406 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:24.029412    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a17563d-5f90-4655-a937-d8537a3805f5-istio-token\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:16:24.029406 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:24.029420    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-istio-envoy\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:16:24.029886 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:24.029428    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a17563d-5f90-4655-a937-d8537a3805f5-istio-data\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:16:24.029886 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:24.029435    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a17563d-5f90-4655-a937-d8537a3805f5-istiod-ca-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:16:24.259770 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:24.259722    2579 generic.go:356] "Generic (PLEG): container finished" podID="2a17563d-5f90-4655-a937-d8537a3805f5" containerID="4687b3f51a7e64e248f51ee42b541de80df3f79be2d48fd5153c455ece0085e5" exitCode=0
Sep 11 18:16:24.259955 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:24.259795    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"
Sep 11 18:16:24.259955 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:24.259810    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2" event={"ID":"2a17563d-5f90-4655-a937-d8537a3805f5","Type":"ContainerDied","Data":"4687b3f51a7e64e248f51ee42b541de80df3f79be2d48fd5153c455ece0085e5"}
Sep 11 18:16:24.259955 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:24.259867    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2" event={"ID":"2a17563d-5f90-4655-a937-d8537a3805f5","Type":"ContainerDied","Data":"579d0342fb9c336060c86e052bfb0b3ab7ae85721f7f20869f2afa27b89259b0"}
Sep 11 18:16:24.259955 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:24.259897    2579 scope.go:117] "RemoveContainer" containerID="4687b3f51a7e64e248f51ee42b541de80df3f79be2d48fd5153c455ece0085e5"
Sep 11 18:16:24.269718 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:24.269704    2579 scope.go:117] "RemoveContainer" containerID="6dfee6ce373981017267fd5e33e6c8afb41d48e00ce9f86ddc2501e2d7cc68ae"
Sep 11 18:16:24.278124 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:24.278106    2579 scope.go:117] "RemoveContainer" containerID="4687b3f51a7e64e248f51ee42b541de80df3f79be2d48fd5153c455ece0085e5"
Sep 11 18:16:24.278413 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:16:24.278393    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4687b3f51a7e64e248f51ee42b541de80df3f79be2d48fd5153c455ece0085e5\": container with ID starting with 4687b3f51a7e64e248f51ee42b541de80df3f79be2d48fd5153c455ece0085e5 not found: ID does not exist" containerID="4687b3f51a7e64e248f51ee42b541de80df3f79be2d48fd5153c455ece0085e5"
Sep 11 18:16:24.278491 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:24.278421    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4687b3f51a7e64e248f51ee42b541de80df3f79be2d48fd5153c455ece0085e5"} err="failed to get container status \"4687b3f51a7e64e248f51ee42b541de80df3f79be2d48fd5153c455ece0085e5\": rpc error: code = NotFound desc = could not find container \"4687b3f51a7e64e248f51ee42b541de80df3f79be2d48fd5153c455ece0085e5\": container with ID starting with 4687b3f51a7e64e248f51ee42b541de80df3f79be2d48fd5153c455ece0085e5 not found: ID does not exist"
Sep 11 18:16:24.278491 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:24.278440    2579 scope.go:117] "RemoveContainer" containerID="6dfee6ce373981017267fd5e33e6c8afb41d48e00ce9f86ddc2501e2d7cc68ae"
Sep 11 18:16:24.278702 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:16:24.278683    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dfee6ce373981017267fd5e33e6c8afb41d48e00ce9f86ddc2501e2d7cc68ae\": container with ID starting with 6dfee6ce373981017267fd5e33e6c8afb41d48e00ce9f86ddc2501e2d7cc68ae not found: ID does not exist" containerID="6dfee6ce373981017267fd5e33e6c8afb41d48e00ce9f86ddc2501e2d7cc68ae"
Sep 11 18:16:24.278745 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:24.278708    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dfee6ce373981017267fd5e33e6c8afb41d48e00ce9f86ddc2501e2d7cc68ae"} err="failed to get container status \"6dfee6ce373981017267fd5e33e6c8afb41d48e00ce9f86ddc2501e2d7cc68ae\": rpc error: code = NotFound desc = could not find container \"6dfee6ce373981017267fd5e33e6c8afb41d48e00ce9f86ddc2501e2d7cc68ae\": container with ID starting with 6dfee6ce373981017267fd5e33e6c8afb41d48e00ce9f86ddc2501e2d7cc68ae not found: ID does not exist"
Sep 11 18:16:24.283718 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:24.283681    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"]
Sep 11 18:16:24.289513 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:24.289492    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2"]
Sep 11 18:16:25.534187 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:16:25.534146    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a17563d-5f90-4655-a937-d8537a3805f5" path="/var/lib/kubelet/pods/2a17563d-5f90-4655-a937-d8537a3805f5/volumes"
Sep 11 18:17:07.987151 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:07.987116    2579 scope.go:117] "RemoveContainer" containerID="1403723ac7e98ed752431776a09d87884f4cd3552f7cc941cb272ffe7aac5b95"
Sep 11 18:17:07.995823 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:07.995797    2579 scope.go:117] "RemoveContainer" containerID="d364fd101a8d6f3ee64130763ad8b61aa2c19e75a00ef8554ea91178e1d4c64c"
Sep 11 18:17:08.004229 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:08.004210    2579 scope.go:117] "RemoveContainer" containerID="09fb58ad2d60dd0b9ea0b5327bb9924ac533c56e7fd2d340c84b471da4051507"
Sep 11 18:17:22.872852 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:22.872813    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-859c5cb57-ljphr"]
Sep 11 18:17:22.873268 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:22.873243    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a17563d-5f90-4655-a937-d8537a3805f5" containerName="istio-proxy"
Sep 11 18:17:22.873268 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:22.873255    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a17563d-5f90-4655-a937-d8537a3805f5" containerName="istio-proxy"
Sep 11 18:17:22.873416 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:22.873274    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d5b23c6-db2f-40db-bef9-b12194fbd9b0" containerName="revoke-keys"
Sep 11 18:17:22.873416 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:22.873280    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d5b23c6-db2f-40db-bef9-b12194fbd9b0" containerName="revoke-keys"
Sep 11 18:17:22.873416 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:22.873290    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="915d571b-b41a-4bb3-8b66-5424153832ad" containerName="istio-proxy"
Sep 11 18:17:22.873416 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:22.873296    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="915d571b-b41a-4bb3-8b66-5424153832ad" containerName="istio-proxy"
Sep 11 18:17:22.873416 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:22.873377    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="915d571b-b41a-4bb3-8b66-5424153832ad" containerName="istio-proxy"
Sep 11 18:17:22.873416 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:22.873391    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a17563d-5f90-4655-a937-d8537a3805f5" containerName="istio-proxy"
Sep 11 18:17:22.873416 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:22.873401    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d5b23c6-db2f-40db-bef9-b12194fbd9b0" containerName="revoke-keys"
Sep 11 18:17:22.876415 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:22.876396    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-859c5cb57-ljphr"
Sep 11 18:17:22.878769 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:22.878745    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 18:17:22.879403 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:22.879384    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 18:17:22.879549 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:22.879531    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xn9bs\""
Sep 11 18:17:22.879623 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:22.879599    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 18:17:22.887335 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:22.887313    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-859c5cb57-ljphr"]
Sep 11 18:17:22.989264 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:22.989225    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/514bc472-471d-483a-83a4-52f086c7d679-webhook-cert\") pod \"maas-controller-859c5cb57-ljphr\" (UID: \"514bc472-471d-483a-83a4-52f086c7d679\") " pod="opendatahub/maas-controller-859c5cb57-ljphr"
Sep 11 18:17:22.989450 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:22.989274    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmv8j\" (UniqueName: \"kubernetes.io/projected/514bc472-471d-483a-83a4-52f086c7d679-kube-api-access-nmv8j\") pod \"maas-controller-859c5cb57-ljphr\" (UID: \"514bc472-471d-483a-83a4-52f086c7d679\") " pod="opendatahub/maas-controller-859c5cb57-ljphr"
Sep 11 18:17:22.989450 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:22.989333    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/514bc472-471d-483a-83a4-52f086c7d679-metrics-certs\") pod \"maas-controller-859c5cb57-ljphr\" (UID: \"514bc472-471d-483a-83a4-52f086c7d679\") " pod="opendatahub/maas-controller-859c5cb57-ljphr"
Sep 11 18:17:23.090006 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:23.089967    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/514bc472-471d-483a-83a4-52f086c7d679-webhook-cert\") pod \"maas-controller-859c5cb57-ljphr\" (UID: \"514bc472-471d-483a-83a4-52f086c7d679\") " pod="opendatahub/maas-controller-859c5cb57-ljphr"
Sep 11 18:17:23.090006 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:23.090017    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmv8j\" (UniqueName: \"kubernetes.io/projected/514bc472-471d-483a-83a4-52f086c7d679-kube-api-access-nmv8j\") pod \"maas-controller-859c5cb57-ljphr\" (UID: \"514bc472-471d-483a-83a4-52f086c7d679\") " pod="opendatahub/maas-controller-859c5cb57-ljphr"
Sep 11 18:17:23.090238 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:23.090055    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/514bc472-471d-483a-83a4-52f086c7d679-metrics-certs\") pod \"maas-controller-859c5cb57-ljphr\" (UID: \"514bc472-471d-483a-83a4-52f086c7d679\") " pod="opendatahub/maas-controller-859c5cb57-ljphr"
Sep 11 18:17:23.092504 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:23.092475    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/514bc472-471d-483a-83a4-52f086c7d679-metrics-certs\") pod \"maas-controller-859c5cb57-ljphr\" (UID: \"514bc472-471d-483a-83a4-52f086c7d679\") " pod="opendatahub/maas-controller-859c5cb57-ljphr"
Sep 11 18:17:23.092618 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:23.092591    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/514bc472-471d-483a-83a4-52f086c7d679-webhook-cert\") pod \"maas-controller-859c5cb57-ljphr\" (UID: \"514bc472-471d-483a-83a4-52f086c7d679\") " pod="opendatahub/maas-controller-859c5cb57-ljphr"
Sep 11 18:17:23.098229 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:23.098205    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmv8j\" (UniqueName: \"kubernetes.io/projected/514bc472-471d-483a-83a4-52f086c7d679-kube-api-access-nmv8j\") pod \"maas-controller-859c5cb57-ljphr\" (UID: \"514bc472-471d-483a-83a4-52f086c7d679\") " pod="opendatahub/maas-controller-859c5cb57-ljphr"
Sep 11 18:17:23.187341 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:23.187248    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-859c5cb57-ljphr"
Sep 11 18:17:23.459704 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:23.459677    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-859c5cb57-ljphr"]
Sep 11 18:17:23.461967 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:17:23.461938    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod514bc472_471d_483a_83a4_52f086c7d679.slice/crio-24643731694f5f0eb461d7a4a37c27b95ac591bb956bdf2ea59a4971361723fe WatchSource:0}: Error finding container 24643731694f5f0eb461d7a4a37c27b95ac591bb956bdf2ea59a4971361723fe: Status 404 returned error can't find the container with id 24643731694f5f0eb461d7a4a37c27b95ac591bb956bdf2ea59a4971361723fe
Sep 11 18:17:23.463702 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:23.463682    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 18:17:23.584649 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:23.584610    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-859c5cb57-ljphr" event={"ID":"514bc472-471d-483a-83a4-52f086c7d679","Type":"ContainerStarted","Data":"24643731694f5f0eb461d7a4a37c27b95ac591bb956bdf2ea59a4971361723fe"}
Sep 11 18:17:24.592097 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:24.592057    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-859c5cb57-ljphr" event={"ID":"514bc472-471d-483a-83a4-52f086c7d679","Type":"ContainerStarted","Data":"6f41646a564a5369760a22ec741a2a553b33ab331bf78a15850888ca0c75380f"}
Sep 11 18:17:24.592577 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:24.592140    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-859c5cb57-ljphr"
Sep 11 18:17:24.612918 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:24.612856    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-859c5cb57-ljphr" podStartSLOduration=2.040213217 podStartE2EDuration="2.61284079s" totalImagesPullingTime="572.627573ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:17:24.608935231 +0000 UTC m=+1937.534886977" watchObservedRunningTime="2026-09-11 18:17:24.61284079 +0000 UTC m=+1937.538792536"
Sep 11 18:17:35.600147 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:35.600109    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-859c5cb57-ljphr"
Sep 11 18:17:45.031678 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:45.031639    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-859c5cb57-ljphr"]
Sep 11 18:17:45.032294 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:45.031856    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-859c5cb57-ljphr" podUID="514bc472-471d-483a-83a4-52f086c7d679" containerName="manager" containerID="cri-o://6f41646a564a5369760a22ec741a2a553b33ab331bf78a15850888ca0c75380f" gracePeriod=30
Sep 11 18:17:45.278301 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:45.278275    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-859c5cb57-ljphr"
Sep 11 18:17:45.405087 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:45.405002    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmv8j\" (UniqueName: \"kubernetes.io/projected/514bc472-471d-483a-83a4-52f086c7d679-kube-api-access-nmv8j\") pod \"514bc472-471d-483a-83a4-52f086c7d679\" (UID: \"514bc472-471d-483a-83a4-52f086c7d679\") "
Sep 11 18:17:45.405237 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:45.405113    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/514bc472-471d-483a-83a4-52f086c7d679-webhook-cert\") pod \"514bc472-471d-483a-83a4-52f086c7d679\" (UID: \"514bc472-471d-483a-83a4-52f086c7d679\") "
Sep 11 18:17:45.405237 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:45.405143    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/514bc472-471d-483a-83a4-52f086c7d679-metrics-certs\") pod \"514bc472-471d-483a-83a4-52f086c7d679\" (UID: \"514bc472-471d-483a-83a4-52f086c7d679\") "
Sep 11 18:17:45.407138 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:45.407105    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/514bc472-471d-483a-83a4-52f086c7d679-kube-api-access-nmv8j" (OuterVolumeSpecName: "kube-api-access-nmv8j") pod "514bc472-471d-483a-83a4-52f086c7d679" (UID: "514bc472-471d-483a-83a4-52f086c7d679"). InnerVolumeSpecName "kube-api-access-nmv8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:17:45.407138 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:45.407126    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/514bc472-471d-483a-83a4-52f086c7d679-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "514bc472-471d-483a-83a4-52f086c7d679" (UID: "514bc472-471d-483a-83a4-52f086c7d679"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:17:45.407326 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:45.407211    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/514bc472-471d-483a-83a4-52f086c7d679-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "514bc472-471d-483a-83a4-52f086c7d679" (UID: "514bc472-471d-483a-83a4-52f086c7d679"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:17:45.506160 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:45.506112    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/514bc472-471d-483a-83a4-52f086c7d679-webhook-cert\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:17:45.506160 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:45.506154    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/514bc472-471d-483a-83a4-52f086c7d679-metrics-certs\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:17:45.506160 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:45.506166    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmv8j\" (UniqueName: \"kubernetes.io/projected/514bc472-471d-483a-83a4-52f086c7d679-kube-api-access-nmv8j\") on node \"ip-10-0-140-211.ec2.internal\" DevicePath \"\""
Sep 11 18:17:45.732794 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:45.732591    2579 generic.go:356] "Generic (PLEG): container finished" podID="514bc472-471d-483a-83a4-52f086c7d679" containerID="6f41646a564a5369760a22ec741a2a553b33ab331bf78a15850888ca0c75380f" exitCode=0
Sep 11 18:17:45.732794 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:45.732647    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-859c5cb57-ljphr"
Sep 11 18:17:45.732794 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:45.732701    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-859c5cb57-ljphr" event={"ID":"514bc472-471d-483a-83a4-52f086c7d679","Type":"ContainerDied","Data":"6f41646a564a5369760a22ec741a2a553b33ab331bf78a15850888ca0c75380f"}
Sep 11 18:17:45.733081 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:45.732853    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-859c5cb57-ljphr" event={"ID":"514bc472-471d-483a-83a4-52f086c7d679","Type":"ContainerDied","Data":"24643731694f5f0eb461d7a4a37c27b95ac591bb956bdf2ea59a4971361723fe"}
Sep 11 18:17:45.733081 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:45.732895    2579 scope.go:117] "RemoveContainer" containerID="6f41646a564a5369760a22ec741a2a553b33ab331bf78a15850888ca0c75380f"
Sep 11 18:17:45.744846 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:45.744722    2579 scope.go:117] "RemoveContainer" containerID="6f41646a564a5369760a22ec741a2a553b33ab331bf78a15850888ca0c75380f"
Sep 11 18:17:45.745143 ip-10-0-140-211 kubenswrapper[2579]: E0911 18:17:45.745116    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f41646a564a5369760a22ec741a2a553b33ab331bf78a15850888ca0c75380f\": container with ID starting with 6f41646a564a5369760a22ec741a2a553b33ab331bf78a15850888ca0c75380f not found: ID does not exist" containerID="6f41646a564a5369760a22ec741a2a553b33ab331bf78a15850888ca0c75380f"
Sep 11 18:17:45.745244 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:45.745155    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f41646a564a5369760a22ec741a2a553b33ab331bf78a15850888ca0c75380f"} err="failed to get container status \"6f41646a564a5369760a22ec741a2a553b33ab331bf78a15850888ca0c75380f\": rpc error: code = NotFound desc = could not find container \"6f41646a564a5369760a22ec741a2a553b33ab331bf78a15850888ca0c75380f\": container with ID starting with 6f41646a564a5369760a22ec741a2a553b33ab331bf78a15850888ca0c75380f not found: ID does not exist"
Sep 11 18:17:45.752989 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:45.752966    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-859c5cb57-ljphr"]
Sep 11 18:17:45.756163 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:45.756141    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-859c5cb57-ljphr"]
Sep 11 18:17:46.589408 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.589373    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-859c5cb57-spzw9"]
Sep 11 18:17:46.589828 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.589792    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a17563d-5f90-4655-a937-d8537a3805f5" containerName="istio-proxy"
Sep 11 18:17:46.589828 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.589803    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a17563d-5f90-4655-a937-d8537a3805f5" containerName="istio-proxy"
Sep 11 18:17:46.589828 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.589819    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="514bc472-471d-483a-83a4-52f086c7d679" containerName="manager"
Sep 11 18:17:46.589828 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.589825    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="514bc472-471d-483a-83a4-52f086c7d679" containerName="manager"
Sep 11 18:17:46.589992 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.589838    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="915d571b-b41a-4bb3-8b66-5424153832ad" containerName="istio-proxy"
Sep 11 18:17:46.589992 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.589844    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="915d571b-b41a-4bb3-8b66-5424153832ad" containerName="istio-proxy"
Sep 11 18:17:46.589992 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.589928    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="514bc472-471d-483a-83a4-52f086c7d679" containerName="manager"
Sep 11 18:17:46.589992 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.589937    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a17563d-5f90-4655-a937-d8537a3805f5" containerName="istio-proxy"
Sep 11 18:17:46.589992 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.589947    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="915d571b-b41a-4bb3-8b66-5424153832ad" containerName="istio-proxy"
Sep 11 18:17:46.594177 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.594157    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-859c5cb57-spzw9"
Sep 11 18:17:46.596883 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.596857    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 18:17:46.597016 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.596934    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 18:17:46.597016 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.596959    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 18:17:46.597016 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.596938    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xn9bs\""
Sep 11 18:17:46.602580 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.602556    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-859c5cb57-spzw9"]
Sep 11 18:17:46.720099 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.720066    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/516937df-2429-4cbc-b8d5-183c2d68f476-webhook-cert\") pod \"maas-controller-859c5cb57-spzw9\" (UID: \"516937df-2429-4cbc-b8d5-183c2d68f476\") " pod="opendatahub/maas-controller-859c5cb57-spzw9"
Sep 11 18:17:46.720248 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.720113    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/516937df-2429-4cbc-b8d5-183c2d68f476-metrics-certs\") pod \"maas-controller-859c5cb57-spzw9\" (UID: \"516937df-2429-4cbc-b8d5-183c2d68f476\") " pod="opendatahub/maas-controller-859c5cb57-spzw9"
Sep 11 18:17:46.720248 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.720201    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pzvz\" (UniqueName: \"kubernetes.io/projected/516937df-2429-4cbc-b8d5-183c2d68f476-kube-api-access-2pzvz\") pod \"maas-controller-859c5cb57-spzw9\" (UID: \"516937df-2429-4cbc-b8d5-183c2d68f476\") " pod="opendatahub/maas-controller-859c5cb57-spzw9"
Sep 11 18:17:46.821166 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.821135    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pzvz\" (UniqueName: \"kubernetes.io/projected/516937df-2429-4cbc-b8d5-183c2d68f476-kube-api-access-2pzvz\") pod \"maas-controller-859c5cb57-spzw9\" (UID: \"516937df-2429-4cbc-b8d5-183c2d68f476\") " pod="opendatahub/maas-controller-859c5cb57-spzw9"
Sep 11 18:17:46.821370 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.821193    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/516937df-2429-4cbc-b8d5-183c2d68f476-webhook-cert\") pod \"maas-controller-859c5cb57-spzw9\" (UID: \"516937df-2429-4cbc-b8d5-183c2d68f476\") " pod="opendatahub/maas-controller-859c5cb57-spzw9"
Sep 11 18:17:46.821370 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.821227    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/516937df-2429-4cbc-b8d5-183c2d68f476-metrics-certs\") pod \"maas-controller-859c5cb57-spzw9\" (UID: \"516937df-2429-4cbc-b8d5-183c2d68f476\") " pod="opendatahub/maas-controller-859c5cb57-spzw9"
Sep 11 18:17:46.823685 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.823654    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/516937df-2429-4cbc-b8d5-183c2d68f476-webhook-cert\") pod \"maas-controller-859c5cb57-spzw9\" (UID: \"516937df-2429-4cbc-b8d5-183c2d68f476\") " pod="opendatahub/maas-controller-859c5cb57-spzw9"
Sep 11 18:17:46.823842 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.823824    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/516937df-2429-4cbc-b8d5-183c2d68f476-metrics-certs\") pod \"maas-controller-859c5cb57-spzw9\" (UID: \"516937df-2429-4cbc-b8d5-183c2d68f476\") " pod="opendatahub/maas-controller-859c5cb57-spzw9"
Sep 11 18:17:46.829374 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.829350    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pzvz\" (UniqueName: \"kubernetes.io/projected/516937df-2429-4cbc-b8d5-183c2d68f476-kube-api-access-2pzvz\") pod \"maas-controller-859c5cb57-spzw9\" (UID: \"516937df-2429-4cbc-b8d5-183c2d68f476\") " pod="opendatahub/maas-controller-859c5cb57-spzw9"
Sep 11 18:17:46.905902 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:46.905813    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-859c5cb57-spzw9"
Sep 11 18:17:47.178567 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:47.178539    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-859c5cb57-spzw9"]
Sep 11 18:17:47.181066 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:17:47.181038    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516937df_2429_4cbc_b8d5_183c2d68f476.slice/crio-5b7ae437e251078b04979352c31df9a7766853b1b7501129cc38dbe3161117af WatchSource:0}: Error finding container 5b7ae437e251078b04979352c31df9a7766853b1b7501129cc38dbe3161117af: Status 404 returned error can't find the container with id 5b7ae437e251078b04979352c31df9a7766853b1b7501129cc38dbe3161117af
Sep 11 18:17:47.535037 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:47.535007    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="514bc472-471d-483a-83a4-52f086c7d679" path="/var/lib/kubelet/pods/514bc472-471d-483a-83a4-52f086c7d679/volumes"
Sep 11 18:17:47.746966 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:47.746927    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-859c5cb57-spzw9" event={"ID":"516937df-2429-4cbc-b8d5-183c2d68f476","Type":"ContainerStarted","Data":"1e6c09934815acced3b73036b0f331f386530f3148ac6bbe00cb3da5e0159f41"}
Sep 11 18:17:47.747425 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:47.746988    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-859c5cb57-spzw9" event={"ID":"516937df-2429-4cbc-b8d5-183c2d68f476","Type":"ContainerStarted","Data":"5b7ae437e251078b04979352c31df9a7766853b1b7501129cc38dbe3161117af"}
Sep 11 18:17:47.747425 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:47.747041    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-859c5cb57-spzw9"
Sep 11 18:17:47.764981 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:47.764934    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-859c5cb57-spzw9" podStartSLOduration=1.393944517 podStartE2EDuration="1.764918778s" totalImagesPullingTime="370.974261ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:17:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:17:47.762803216 +0000 UTC m=+1960.688754961" watchObservedRunningTime="2026-09-11 18:17:47.764918778 +0000 UTC m=+1960.690870523"
Sep 11 18:17:58.755151 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:17:58.755115    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-859c5cb57-spzw9"
Sep 11 18:20:07.671103 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:20:07.671072    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-bbhjk_46c0eccf-9fc2-4fbf-ae39-3b1cf093b352/console-operator/1.log"
Sep 11 18:20:07.675279 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:20:07.675255    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zx6_cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd/ovn-acl-logging/0.log"
Sep 11 18:20:07.677935 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:20:07.677914    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-bbhjk_46c0eccf-9fc2-4fbf-ae39-3b1cf093b352/console-operator/1.log"
Sep 11 18:20:07.681811 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:20:07.681793    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zx6_cdd7b59a-6f4b-46fb-a38e-92baa4ffc9cd/ovn-acl-logging/0.log"
Sep 11 18:20:08.059921 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:20:08.059887    2579 scope.go:117] "RemoveContainer" containerID="31c4a741b55696e1a8899fa59ae0ba7f3f059490342aecd6ec19e3118a00ae72"
Sep 11 18:21:08.079697 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:21:08.079617    2579 scope.go:117] "RemoveContainer" containerID="be0e095bde0b8131405ea42506fac36c0ce16349b607f6c9cedeabd8da1caa5a"
Sep 11 18:21:08.088581 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:21:08.088556    2579 scope.go:117] "RemoveContainer" containerID="554402a92148d5b73f43593c910616edbf37e944961e84089c2993ae31a0c217"
Sep 11 18:22:08.116421 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:08.116384    2579 scope.go:117] "RemoveContainer" containerID="e9621fbafe7bcb79cf2f9ef86e78235817eddb05e16e7411f63b0aa8b9ef11aa"
Sep 11 18:22:08.124684 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:08.124664    2579 scope.go:117] "RemoveContainer" containerID="cda3bd15e698bf62185f1877accf78794177638a729c5d39b4d1ce62e120e020"
Sep 11 18:22:08.135593 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:08.135573    2579 scope.go:117] "RemoveContainer" containerID="5c993fb51c959624ef7a40b51e3afba92c42398e6a03e8610299e05b373644b0"
Sep 11 18:22:16.596550 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:16.596517    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6d9x7_0d05abf5-3dec-4787-8f04-1d4c88531564/manager/0.log"
Sep 11 18:22:16.735138 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:16.735105    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-pjlwk_5dc7125d-0734-414b-ab41-15bd9664440b/manager/0.log"
Sep 11 18:22:16.870559 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:16.870490    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-859c5cb57-spzw9_516937df-2429-4cbc-b8d5-183c2d68f476/manager/0.log"
Sep 11 18:22:17.008347 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:17.008320    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pn8tm_2ca19e07-7926-4de6-afcd-6e314a975d44/server/0.log"
Sep 11 18:22:17.138163 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:17.138085    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9x8lq_11cb31a3-3a26-4914-ad94-3e265a921326/manager/0.log"
Sep 11 18:22:17.569902 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:17.569876    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f44bff486-vqrdn_4d4af3d8-024c-4732-afe9-15e7f59a73aa/copy-manifests/0.log"
Sep 11 18:22:17.577220 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:17.577198    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f44bff486-vqrdn_4d4af3d8-024c-4732-afe9-15e7f59a73aa/manager/0.log"
Sep 11 18:22:18.346950 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:18.346920    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29819175-7dqpk_c41dc829-160a-499b-aa18-2eae6f1c4ed3/cleanup/0.log"
Sep 11 18:22:20.053235 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:20.053207    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-bhv4t_7f5364b9-72d5-4b62-b090-11b1da53bcaa/manager/0.log"
Sep 11 18:22:20.464707 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:20.464626    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt_c6e3def9-2868-4b61-a0e5-836df8bde7d1/istio-proxy/0.log"
Sep 11 18:22:20.977571 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:20.977542    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9z8xb_15a0c1fc-f412-439b-993d-b4d4008122a2/istio-proxy/1.log"
Sep 11 18:22:21.106157 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:21.106126    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-f858k_d16f34f1-6634-4930-bc4e-f78a3a0d05c7/payload-pre-processing/0.log"
Sep 11 18:22:21.769306 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:21.769277    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-8hnfx_64fabc45-3b2f-491d-894b-275d0202b64e/main/0.log"
Sep 11 18:22:21.898820 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:21.898789    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-s4shm_711e47e0-66fd-4575-b6fe-c2a67f0c39a1/main/0.log"
Sep 11 18:22:22.156085 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:22.155973    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-8g7p8_bc55f671-4269-415d-a71d-618264b8a0de/main/0.log"
Sep 11 18:22:28.553109 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:28.553072    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9wf2k/must-gather-rfxbw"]
Sep 11 18:22:28.556949 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:28.556929    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9wf2k/must-gather-rfxbw"
Sep 11 18:22:28.559617 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:28.559587    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9wf2k\"/\"openshift-service-ca.crt\""
Sep 11 18:22:28.559995 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:28.559975    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9wf2k\"/\"default-dockercfg-zgzn2\""
Sep 11 18:22:28.560321 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:28.560307    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9wf2k\"/\"kube-root-ca.crt\""
Sep 11 18:22:28.570521 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:28.570495    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9wf2k/must-gather-rfxbw"]
Sep 11 18:22:28.629317 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:28.629283    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6fa89db2-fe2d-4dd2-837a-665e1d8839b4-must-gather-output\") pod \"must-gather-rfxbw\" (UID: \"6fa89db2-fe2d-4dd2-837a-665e1d8839b4\") " pod="openshift-must-gather-9wf2k/must-gather-rfxbw"
Sep 11 18:22:28.629506 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:28.629421    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b25nm\" (UniqueName: \"kubernetes.io/projected/6fa89db2-fe2d-4dd2-837a-665e1d8839b4-kube-api-access-b25nm\") pod \"must-gather-rfxbw\" (UID: \"6fa89db2-fe2d-4dd2-837a-665e1d8839b4\") " pod="openshift-must-gather-9wf2k/must-gather-rfxbw"
Sep 11 18:22:28.730150 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:28.730111    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b25nm\" (UniqueName: \"kubernetes.io/projected/6fa89db2-fe2d-4dd2-837a-665e1d8839b4-kube-api-access-b25nm\") pod \"must-gather-rfxbw\" (UID: \"6fa89db2-fe2d-4dd2-837a-665e1d8839b4\") " pod="openshift-must-gather-9wf2k/must-gather-rfxbw"
Sep 11 18:22:28.730314 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:28.730170    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6fa89db2-fe2d-4dd2-837a-665e1d8839b4-must-gather-output\") pod \"must-gather-rfxbw\" (UID: \"6fa89db2-fe2d-4dd2-837a-665e1d8839b4\") " pod="openshift-must-gather-9wf2k/must-gather-rfxbw"
Sep 11 18:22:28.730485 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:28.730459    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6fa89db2-fe2d-4dd2-837a-665e1d8839b4-must-gather-output\") pod \"must-gather-rfxbw\" (UID: \"6fa89db2-fe2d-4dd2-837a-665e1d8839b4\") " pod="openshift-must-gather-9wf2k/must-gather-rfxbw"
Sep 11 18:22:28.738701 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:28.738669    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b25nm\" (UniqueName: \"kubernetes.io/projected/6fa89db2-fe2d-4dd2-837a-665e1d8839b4-kube-api-access-b25nm\") pod \"must-gather-rfxbw\" (UID: \"6fa89db2-fe2d-4dd2-837a-665e1d8839b4\") " pod="openshift-must-gather-9wf2k/must-gather-rfxbw"
Sep 11 18:22:28.867025 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:28.866942    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9wf2k/must-gather-rfxbw"
Sep 11 18:22:29.142704 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:29.142679    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9wf2k/must-gather-rfxbw"]
Sep 11 18:22:29.144851 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:22:29.144806    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6fa89db2_fe2d_4dd2_837a_665e1d8839b4.slice/crio-6f9be07b9b82d9b12b62dccc0e80dd4fb548a0f343a2fe8692346d5105134c1d WatchSource:0}: Error finding container 6f9be07b9b82d9b12b62dccc0e80dd4fb548a0f343a2fe8692346d5105134c1d: Status 404 returned error can't find the container with id 6f9be07b9b82d9b12b62dccc0e80dd4fb548a0f343a2fe8692346d5105134c1d
Sep 11 18:22:29.146834 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:29.146817    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 18:22:29.273911 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:29.273875    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9wf2k/must-gather-rfxbw" event={"ID":"6fa89db2-fe2d-4dd2-837a-665e1d8839b4","Type":"ContainerStarted","Data":"6f9be07b9b82d9b12b62dccc0e80dd4fb548a0f343a2fe8692346d5105134c1d"}
Sep 11 18:22:31.287307 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:31.287260    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9wf2k/must-gather-rfxbw" event={"ID":"6fa89db2-fe2d-4dd2-837a-665e1d8839b4","Type":"ContainerStarted","Data":"3f0beb98d970303a9a3d44dc29ba971aa2b473c5d4f4564d12cb31be1078fa4b"}
Sep 11 18:22:31.287793 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:31.287323    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9wf2k/must-gather-rfxbw" event={"ID":"6fa89db2-fe2d-4dd2-837a-665e1d8839b4","Type":"ContainerStarted","Data":"beb40656c9ec319d966b443612daa2a462568a9d1adb377d07f784592723c19c"}
Sep 11 18:22:31.312890 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:31.312835    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9wf2k/must-gather-rfxbw" podStartSLOduration=2.247755553 podStartE2EDuration="3.312819609s" totalImagesPullingTime="1.065064056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:22:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:22:31.309896817 +0000 UTC m=+2244.235848560" watchObservedRunningTime="2026-09-11 18:22:31.312819609 +0000 UTC m=+2244.238771355"
Sep 11 18:22:32.003198 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:32.003171    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fzfxg_74532c4c-1206-4467-90af-b6dca8c3b5ac/global-pull-secret-syncer/0.log"
Sep 11 18:22:32.244627 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:32.244586    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tvgkk_5a40983e-4ca5-4166-93c0-30f9432dbfbf/konnectivity-agent/0.log"
Sep 11 18:22:32.401299 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:32.401212    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-211.ec2.internal_42033061b2efc1a5de4a9db1dfbac058/haproxy/0.log"
Sep 11 18:22:37.388565 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:37.388470    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-bhv4t_7f5364b9-72d5-4b62-b090-11b1da53bcaa/manager/0.log"
Sep 11 18:22:39.265177 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:39.265016    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-4j9td_971cc6c8-731b-486b-8f31-bb4d99ab2364/cluster-monitoring-operator/0.log"
Sep 11 18:22:39.295289 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:39.295244    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-pbcx9_6dfb1f42-ef31-4c26-a471-e32e2085d2e6/kube-state-metrics/0.log"
Sep 11 18:22:39.320426 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:39.320392    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-pbcx9_6dfb1f42-ef31-4c26-a471-e32e2085d2e6/kube-rbac-proxy-main/0.log"
Sep 11 18:22:39.349488 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:39.349460    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-pbcx9_6dfb1f42-ef31-4c26-a471-e32e2085d2e6/kube-rbac-proxy-self/0.log"
Sep 11 18:22:39.412506 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:39.412465    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-6t4ps_51ed57de-bab7-4b62-93ab-e82079b839c3/monitoring-plugin/0.log"
Sep 11 18:22:39.648507 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:39.648478    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-psdvb_dccb0c59-a0b5-46d6-a397-de521c8a3c24/node-exporter/0.log"
Sep 11 18:22:39.679787 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:39.679708    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-psdvb_dccb0c59-a0b5-46d6-a397-de521c8a3c24/kube-rbac-proxy/0.log"
Sep 11 18:22:39.706745 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:39.706700    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-psdvb_dccb0c59-a0b5-46d6-a397-de521c8a3c24/init-textfile/0.log"
Sep 11 18:22:39.737782 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:39.737740    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-plwfq_ecd08429-25a9-4c91-aea0-d3ad18d6a5bc/kube-rbac-proxy-main/0.log"
Sep 11 18:22:39.768264 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:39.768212    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-plwfq_ecd08429-25a9-4c91-aea0-d3ad18d6a5bc/kube-rbac-proxy-self/0.log"
Sep 11 18:22:39.797270 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:39.797238    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-plwfq_ecd08429-25a9-4c91-aea0-d3ad18d6a5bc/openshift-state-metrics/0.log"
Sep 11 18:22:39.843171 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:39.843091    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bee1fa5d-0469-4be9-a3ea-aab1e2c8face/prometheus/0.log"
Sep 11 18:22:39.882746 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:39.882718    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bee1fa5d-0469-4be9-a3ea-aab1e2c8face/config-reloader/0.log"
Sep 11 18:22:39.965388 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:39.965331    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bee1fa5d-0469-4be9-a3ea-aab1e2c8face/thanos-sidecar/0.log"
Sep 11 18:22:40.042394 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:40.042347    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bee1fa5d-0469-4be9-a3ea-aab1e2c8face/kube-rbac-proxy-web/0.log"
Sep 11 18:22:40.074198 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:40.074142    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bee1fa5d-0469-4be9-a3ea-aab1e2c8face/kube-rbac-proxy/0.log"
Sep 11 18:22:40.100162 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:40.100058    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bee1fa5d-0469-4be9-a3ea-aab1e2c8face/kube-rbac-proxy-thanos/0.log"
Sep 11 18:22:40.133017 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:40.132984    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bee1fa5d-0469-4be9-a3ea-aab1e2c8face/init-config-reloader/0.log"
Sep 11 18:22:40.216009 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:40.215978    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-j7tlx_40853393-edf0-4187-af44-00052c907622/prometheus-operator-admission-webhook/0.log"
Sep 11 18:22:40.345825 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:40.345781    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78546f8bf8-ppvn5_cfc0cf9d-1bc8-4366-826f-1982c1ad23e0/thanos-query/0.log"
Sep 11 18:22:40.371292 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:40.371227    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78546f8bf8-ppvn5_cfc0cf9d-1bc8-4366-826f-1982c1ad23e0/kube-rbac-proxy-web/0.log"
Sep 11 18:22:40.397685 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:40.397650    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78546f8bf8-ppvn5_cfc0cf9d-1bc8-4366-826f-1982c1ad23e0/kube-rbac-proxy/0.log"
Sep 11 18:22:40.424113 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:40.424080    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78546f8bf8-ppvn5_cfc0cf9d-1bc8-4366-826f-1982c1ad23e0/prom-label-proxy/0.log"
Sep 11 18:22:40.451537 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:40.451486    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78546f8bf8-ppvn5_cfc0cf9d-1bc8-4366-826f-1982c1ad23e0/kube-rbac-proxy-rules/0.log"
Sep 11 18:22:40.478654 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:40.478623    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78546f8bf8-ppvn5_cfc0cf9d-1bc8-4366-826f-1982c1ad23e0/kube-rbac-proxy-metrics/0.log"
Sep 11 18:22:42.082547 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.082498    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"]
Sep 11 18:22:42.087720 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.087693    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"
Sep 11 18:22:42.096395 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.096242    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"]
Sep 11 18:22:42.191020 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.190976    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e94760a-044b-4700-b9c9-f978974778d8-lib-modules\") pod \"perf-node-gather-daemonset-z2h8n\" (UID: \"2e94760a-044b-4700-b9c9-f978974778d8\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"
Sep 11 18:22:42.191276 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.191256    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2e94760a-044b-4700-b9c9-f978974778d8-podres\") pod \"perf-node-gather-daemonset-z2h8n\" (UID: \"2e94760a-044b-4700-b9c9-f978974778d8\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"
Sep 11 18:22:42.191438 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.191424    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e94760a-044b-4700-b9c9-f978974778d8-sys\") pod \"perf-node-gather-daemonset-z2h8n\" (UID: \"2e94760a-044b-4700-b9c9-f978974778d8\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"
Sep 11 18:22:42.191556 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.191543    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6rxn\" (UniqueName: \"kubernetes.io/projected/2e94760a-044b-4700-b9c9-f978974778d8-kube-api-access-j6rxn\") pod \"perf-node-gather-daemonset-z2h8n\" (UID: \"2e94760a-044b-4700-b9c9-f978974778d8\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"
Sep 11 18:22:42.191657 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.191645    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2e94760a-044b-4700-b9c9-f978974778d8-proc\") pod \"perf-node-gather-daemonset-z2h8n\" (UID: \"2e94760a-044b-4700-b9c9-f978974778d8\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"
Sep 11 18:22:42.292671 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.292621    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e94760a-044b-4700-b9c9-f978974778d8-sys\") pod \"perf-node-gather-daemonset-z2h8n\" (UID: \"2e94760a-044b-4700-b9c9-f978974778d8\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"
Sep 11 18:22:42.292885 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.292710    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6rxn\" (UniqueName: \"kubernetes.io/projected/2e94760a-044b-4700-b9c9-f978974778d8-kube-api-access-j6rxn\") pod \"perf-node-gather-daemonset-z2h8n\" (UID: \"2e94760a-044b-4700-b9c9-f978974778d8\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"
Sep 11 18:22:42.292885 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.292754    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2e94760a-044b-4700-b9c9-f978974778d8-proc\") pod \"perf-node-gather-daemonset-z2h8n\" (UID: \"2e94760a-044b-4700-b9c9-f978974778d8\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"
Sep 11 18:22:42.292885 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.292791    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e94760a-044b-4700-b9c9-f978974778d8-sys\") pod \"perf-node-gather-daemonset-z2h8n\" (UID: \"2e94760a-044b-4700-b9c9-f978974778d8\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"
Sep 11 18:22:42.293067 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.292918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e94760a-044b-4700-b9c9-f978974778d8-lib-modules\") pod \"perf-node-gather-daemonset-z2h8n\" (UID: \"2e94760a-044b-4700-b9c9-f978974778d8\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"
Sep 11 18:22:42.293067 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.292933    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2e94760a-044b-4700-b9c9-f978974778d8-proc\") pod \"perf-node-gather-daemonset-z2h8n\" (UID: \"2e94760a-044b-4700-b9c9-f978974778d8\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"
Sep 11 18:22:42.293067 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.292969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2e94760a-044b-4700-b9c9-f978974778d8-podres\") pod \"perf-node-gather-daemonset-z2h8n\" (UID: \"2e94760a-044b-4700-b9c9-f978974778d8\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"
Sep 11 18:22:42.293204 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.293102    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e94760a-044b-4700-b9c9-f978974778d8-lib-modules\") pod \"perf-node-gather-daemonset-z2h8n\" (UID: \"2e94760a-044b-4700-b9c9-f978974778d8\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"
Sep 11 18:22:42.293251 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.293209    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2e94760a-044b-4700-b9c9-f978974778d8-podres\") pod \"perf-node-gather-daemonset-z2h8n\" (UID: \"2e94760a-044b-4700-b9c9-f978974778d8\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"
Sep 11 18:22:42.303870 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.303828    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6rxn\" (UniqueName: \"kubernetes.io/projected/2e94760a-044b-4700-b9c9-f978974778d8-kube-api-access-j6rxn\") pod \"perf-node-gather-daemonset-z2h8n\" (UID: \"2e94760a-044b-4700-b9c9-f978974778d8\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"
Sep 11 18:22:42.400240 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.400151    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-bbhjk_46c0eccf-9fc2-4fbf-ae39-3b1cf093b352/console-operator/1.log"
Sep 11 18:22:42.401057 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.401029    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"
Sep 11 18:22:42.406102 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.406068    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-bbhjk_46c0eccf-9fc2-4fbf-ae39-3b1cf093b352/console-operator/2.log"
Sep 11 18:22:42.708255 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.708180    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"]
Sep 11 18:22:42.710944 ip-10-0-140-211 kubenswrapper[2579]: W0911 18:22:42.710913    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2e94760a_044b_4700_b9c9_f978974778d8.slice/crio-3b04e6e3f6c2e40618d1d61d4d3e24b7fba59d4c975ca0f522423f461dfaa053 WatchSource:0}: Error finding container 3b04e6e3f6c2e40618d1d61d4d3e24b7fba59d4c975ca0f522423f461dfaa053: Status 404 returned error can't find the container with id 3b04e6e3f6c2e40618d1d61d4d3e24b7fba59d4c975ca0f522423f461dfaa053
Sep 11 18:22:42.990927 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:42.990891    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b6858967-hbxmk_efaced64-c8c7-48b8-b7e3-960612195e83/console/0.log"
Sep 11 18:22:43.383669 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:43.383575    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n" event={"ID":"2e94760a-044b-4700-b9c9-f978974778d8","Type":"ContainerStarted","Data":"c00980d50ed47f1d1759ecfda0a9c6371e4aa034cb81715abae06318bd1d955a"}
Sep 11 18:22:43.383669 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:43.383646    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n" event={"ID":"2e94760a-044b-4700-b9c9-f978974778d8","Type":"ContainerStarted","Data":"3b04e6e3f6c2e40618d1d61d4d3e24b7fba59d4c975ca0f522423f461dfaa053"}
Sep 11 18:22:43.384497 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:43.384480    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"
Sep 11 18:22:43.404791 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:43.404566    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n" podStartSLOduration=1.404546367 podStartE2EDuration="1.404546367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:22:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:22:43.40168437 +0000 UTC m=+2256.327636118" watchObservedRunningTime="2026-09-11 18:22:43.404546367 +0000 UTC m=+2256.330498114"
Sep 11 18:22:43.754538 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:43.754504    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-nscqk_03de83d9-5ba9-4e47-ab35-d3bbd80ffecb/volume-data-source-validator/0.log"
Sep 11 18:22:44.944397 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:44.944352    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xnrgn_51199ad2-1d9f-4951-af87-21d70591fdf7/dns/0.log"
Sep 11 18:22:44.971059 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:44.971019    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xnrgn_51199ad2-1d9f-4951-af87-21d70591fdf7/kube-rbac-proxy/0.log"
Sep 11 18:22:45.022749 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:45.022722    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m8n8w_bc2786c3-ff15-4108-b6df-ef1852972821/dns-node-resolver/0.log"
Sep 11 18:22:45.630746 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:45.630717    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6pqzm_73e0fe43-f7e6-4418-b6c2-2f26221c994d/node-ca/0.log"
Sep 11 18:22:46.630411 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:46.630381    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt_c6e3def9-2868-4b61-a0e5-836df8bde7d1/istio-proxy/0.log"
Sep 11 18:22:47.326159 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:47.326124    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9z8xb_15a0c1fc-f412-439b-993d-b4d4008122a2/istio-proxy/0.log"
Sep 11 18:22:47.336262 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:47.336230    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9z8xb_15a0c1fc-f412-439b-993d-b4d4008122a2/istio-proxy/1.log"
Sep 11 18:22:47.405084 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:47.405051    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-f858k_d16f34f1-6634-4930-bc4e-f78a3a0d05c7/payload-pre-processing/0.log"
Sep 11 18:22:48.417826 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:48.417799    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r6npp_7da14b29-4d93-4577-b16c-db6d30d0255e/serve-healthcheck-canary/0.log"
Sep 11 18:22:49.125146 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:49.125109    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z5565_084f613d-75ac-40dd-bc1f-e883a576851b/kube-rbac-proxy/0.log"
Sep 11 18:22:49.149803 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:49.149752    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z5565_084f613d-75ac-40dd-bc1f-e883a576851b/exporter/0.log"
Sep 11 18:22:49.173143 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:49.173115    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z5565_084f613d-75ac-40dd-bc1f-e883a576851b/extractor/0.log"
Sep 11 18:22:50.410839 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:50.410810    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-z2h8n"
Sep 11 18:22:51.341122 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:51.341095    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6d9x7_0d05abf5-3dec-4787-8f04-1d4c88531564/manager/0.log"
Sep 11 18:22:51.597585 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:51.596892    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-pjlwk_5dc7125d-0734-414b-ab41-15bd9664440b/manager/0.log"
Sep 11 18:22:51.657326 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:51.655749    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-859c5cb57-spzw9_516937df-2429-4cbc-b8d5-183c2d68f476/manager/0.log"
Sep 11 18:22:51.679723 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:51.679695    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pn8tm_2ca19e07-7926-4de6-afcd-6e314a975d44/server/0.log"
Sep 11 18:22:51.794078 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:51.794042    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9x8lq_11cb31a3-3a26-4914-ad94-3e265a921326/manager/0.log"
Sep 11 18:22:52.021697 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:52.021668    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f44bff486-vqrdn_4d4af3d8-024c-4732-afe9-15e7f59a73aa/manager/0.log"
Sep 11 18:22:52.048350 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:52.048319    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f44bff486-vqrdn_4d4af3d8-024c-4732-afe9-15e7f59a73aa/copy-manifests/0.log"
Sep 11 18:22:52.646925 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:52.646897    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt_c6e3def9-2868-4b61-a0e5-836df8bde7d1/istio-proxy/0.log"
Sep 11 18:22:53.294630 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:53.294599    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9z8xb_15a0c1fc-f412-439b-993d-b4d4008122a2/istio-proxy/0.log"
Sep 11 18:22:53.305903 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:53.305876    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9z8xb_15a0c1fc-f412-439b-993d-b4d4008122a2/istio-proxy/1.log"
Sep 11 18:22:53.333896 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:53.333861    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-f858k_d16f34f1-6634-4930-bc4e-f78a3a0d05c7/payload-pre-processing/0.log"
Sep 11 18:22:53.561969 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:53.561943    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-f67fb7585-dxhcs_19384377-2e88-469f-b335-be97f1e7529d/manager/0.log"
Sep 11 18:22:53.625529 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:53.625494    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-w4fph_23b40023-b096-4f78-82b6-88426ca96dae/openshift-lws-operator/0.log"
Sep 11 18:22:54.906292 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:54.906259    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt_c6e3def9-2868-4b61-a0e5-836df8bde7d1/istio-proxy/0.log"
Sep 11 18:22:55.549386 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:55.549349    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9z8xb_15a0c1fc-f412-439b-993d-b4d4008122a2/istio-proxy/0.log"
Sep 11 18:22:55.561234 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:55.561202    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9z8xb_15a0c1fc-f412-439b-993d-b4d4008122a2/istio-proxy/1.log"
Sep 11 18:22:55.588930 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:55.588899    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-f858k_d16f34f1-6634-4930-bc4e-f78a3a0d05c7/payload-pre-processing/0.log"
Sep 11 18:22:58.646699 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:58.646659    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-krhbl_a22efa0a-d1db-489d-a75a-e602890932ec/migrator/0.log"
Sep 11 18:22:58.674327 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:22:58.674287    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-krhbl_a22efa0a-d1db-489d-a75a-e602890932ec/graceful-termination/0.log"
Sep 11 18:23:00.132580 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:23:00.132545    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6h9cq_2cbcf37c-4462-4774-b2b9-cae117204cda/kube-multus/0.log"
Sep 11 18:23:00.525018 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:23:00.524991    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hg88l_c48582c7-77a6-40c2-b187-de7038c31e1f/kube-multus-additional-cni-plugins/0.log"
Sep 11 18:23:00.548651 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:23:00.548624    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hg88l_c48582c7-77a6-40c2-b187-de7038c31e1f/egress-router-binary-copy/0.log"
Sep 11 18:23:00.573631 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:23:00.573604    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hg88l_c48582c7-77a6-40c2-b187-de7038c31e1f/cni-plugins/0.log"
Sep 11 18:23:00.596446 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:23:00.596421    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hg88l_c48582c7-77a6-40c2-b187-de7038c31e1f/bond-cni-plugin/0.log"
Sep 11 18:23:00.621638 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:23:00.621565    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hg88l_c48582c7-77a6-40c2-b187-de7038c31e1f/routeoverride-cni/0.log"
Sep 11 18:23:00.646834 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:23:00.646804    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hg88l_c48582c7-77a6-40c2-b187-de7038c31e1f/whereabouts-cni-bincopy/0.log"
Sep 11 18:23:00.672584 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:23:00.672555    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hg88l_c48582c7-77a6-40c2-b187-de7038c31e1f/whereabouts-cni/0.log"
Sep 11 18:23:00.816124 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:23:00.816037    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-27scn_ebc8fd61-b671-4d9e-9e23-756caf55b43c/network-metrics-daemon/0.log"
Sep 11 18:23:00.843255 ip-10-0-140-211 kubenswrapper[2579]: I0911 18:23:00.843216    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-27scn_ebc8fd61-b671-4d9e-9e23-756caf55b43c/kube-rbac-proxy/0.log"