Sep 10 15:13:45.606007 ip-10-0-142-37 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 10 15:13:45.606020 ip-10-0-142-37 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 10 15:13:45.606029 ip-10-0-142-37 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 10 15:13:45.606377 ip-10-0-142-37 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 10 15:13:56.656648 ip-10-0-142-37 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 10 15:13:56.656666 ip-10-0-142-37 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 36ca28d7e875465fb35d227d42796e6f --
Sep 10 15:15:46.843237 ip-10-0-142-37 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 15:15:47.208854 ip-10-0-142-37 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 15:15:47.208854 ip-10-0-142-37 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 15:15:47.208854 ip-10-0-142-37 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 15:15:47.208854 ip-10-0-142-37 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 15:15:47.208854 ip-10-0-142-37 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 15:15:47.211252 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.211158    2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 15:15:47.215530 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215515    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 15:15:47.215530 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215530    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 15:15:47.215593 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215534    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 15:15:47.215593 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215537    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 15:15:47.215593 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215540    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 15:15:47.215593 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215544    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 15:15:47.215593 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215547    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 15:15:47.215593 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215550    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 15:15:47.215593 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215552    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 15:15:47.215593 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215555    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 15:15:47.215593 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215558    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 15:15:47.215593 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215561    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 15:15:47.215593 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215563    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 15:15:47.215593 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215566    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 15:15:47.215593 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215568    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 15:15:47.215593 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215571    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 15:15:47.215593 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215574    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 15:15:47.215593 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215578    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 15:15:47.215593 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215587    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 15:15:47.215593 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215591    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 15:15:47.215593 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215593    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 15:15:47.216101 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215596    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 15:15:47.216101 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215599    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 15:15:47.216101 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215602    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 15:15:47.216101 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215604    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 15:15:47.216101 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215607    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 15:15:47.216101 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215610    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 15:15:47.216101 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215613    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 15:15:47.216101 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215617    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 15:15:47.216101 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215621    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 15:15:47.216101 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215625    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 15:15:47.216101 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215629    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 15:15:47.216101 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215632    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 15:15:47.216101 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215635    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 15:15:47.216101 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215637    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 15:15:47.216101 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215640    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 15:15:47.216101 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215643    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 15:15:47.216101 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215646    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 15:15:47.216101 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215648    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 15:15:47.216101 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215651    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 15:15:47.216563 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215654    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 15:15:47.216563 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215657    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 15:15:47.216563 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215659    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 15:15:47.216563 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215663    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 15:15:47.216563 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215671    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 15:15:47.216563 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215674    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 15:15:47.216563 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215676    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 15:15:47.216563 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215679    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 15:15:47.216563 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215681    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 15:15:47.216563 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215684    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 15:15:47.216563 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215686    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 15:15:47.216563 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215688    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 15:15:47.216563 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215691    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 15:15:47.216563 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215694    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 15:15:47.216563 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215697    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 15:15:47.216563 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215700    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 15:15:47.216563 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215702    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 15:15:47.216563 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215705    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 15:15:47.216563 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215708    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 15:15:47.216563 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215710    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 15:15:47.217057 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215713    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 15:15:47.217057 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215715    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 15:15:47.217057 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215718    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 15:15:47.217057 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215720    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 15:15:47.217057 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215723    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 15:15:47.217057 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215726    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 15:15:47.217057 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215728    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 15:15:47.217057 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215731    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 15:15:47.217057 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215733    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 15:15:47.217057 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215736    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 15:15:47.217057 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215738    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 15:15:47.217057 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215741    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 15:15:47.217057 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215743    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 15:15:47.217057 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215746    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 15:15:47.217057 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215749    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 15:15:47.217057 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215752    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 15:15:47.217057 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215754    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 15:15:47.217057 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215760    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 15:15:47.217057 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215763    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 15:15:47.217057 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215765    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 15:15:47.217549 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215768    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 15:15:47.217549 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215770    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 15:15:47.217549 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215773    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 15:15:47.217549 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215775    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 15:15:47.217549 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215778    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 15:15:47.217549 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215784    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 15:15:47.217549 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215787    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 15:15:47.217549 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215790    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 15:15:47.217549 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215792    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 15:15:47.217549 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215795    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 15:15:47.217549 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215798    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 15:15:47.217549 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215801    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 15:15:47.217549 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215804    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 15:15:47.217549 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215806    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 15:15:47.217549 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215809    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 15:15:47.217549 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215811    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 15:15:47.217549 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215814    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 15:15:47.217549 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215816    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 15:15:47.217549 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.215819    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 15:15:47.217549 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216558    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 15:15:47.218036 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216565    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 15:15:47.218036 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216569    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 15:15:47.218036 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216572    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 15:15:47.218036 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216578    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 15:15:47.218036 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216581    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 15:15:47.218036 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216584    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 15:15:47.218036 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216587    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 15:15:47.218036 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216589    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 15:15:47.218036 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216592    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 15:15:47.218036 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216594    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 15:15:47.218036 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216598    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 15:15:47.218036 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216601    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 15:15:47.218036 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216603    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 15:15:47.218036 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216606    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 15:15:47.218036 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216609    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 15:15:47.218036 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216612    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 15:15:47.218036 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216614    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 15:15:47.218036 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216618    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 15:15:47.218036 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216621    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 15:15:47.218036 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216624    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 15:15:47.218524 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216626    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 15:15:47.218524 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216629    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 15:15:47.218524 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216632    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 15:15:47.218524 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216634    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 15:15:47.218524 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216637    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 15:15:47.218524 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216640    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 15:15:47.218524 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216642    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 15:15:47.218524 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216645    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 15:15:47.218524 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216647    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 15:15:47.218524 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216650    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 15:15:47.218524 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216652    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 15:15:47.218524 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216655    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 15:15:47.218524 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216657    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 15:15:47.218524 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216660    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 15:15:47.218524 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216663    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 15:15:47.218524 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216665    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 15:15:47.218524 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216668    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 15:15:47.218524 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216670    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 15:15:47.218524 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216673    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 15:15:47.218524 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216675    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 15:15:47.219030 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216678    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 15:15:47.219030 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216681    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 15:15:47.219030 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216683    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 15:15:47.219030 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216690    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 15:15:47.219030 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216693    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 15:15:47.219030 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216695    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 15:15:47.219030 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216698    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 15:15:47.219030 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216701    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 15:15:47.219030 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216703    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 15:15:47.219030 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216706    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 15:15:47.219030 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216709    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 15:15:47.219030 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216712    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 15:15:47.219030 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216715    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 15:15:47.219030 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216717    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 15:15:47.219030 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216720    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 15:15:47.219030 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216722    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 15:15:47.219030 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216725    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 15:15:47.219030 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216728    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 15:15:47.219030 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216730    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 15:15:47.219030 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216732    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 15:15:47.219525 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216735    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 15:15:47.219525 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216738    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 15:15:47.219525 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216740    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 15:15:47.219525 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216743    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 15:15:47.219525 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216745    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 15:15:47.219525 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216748    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 15:15:47.219525 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216750    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 15:15:47.219525 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216753    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 15:15:47.219525 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216757    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 15:15:47.219525 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216759    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 15:15:47.219525 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216762    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 15:15:47.219525 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216764    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 15:15:47.219525 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216767    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 15:15:47.219525 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216769    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 15:15:47.219525 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216773    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 15:15:47.219525 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216777    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 15:15:47.219525 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216780    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 15:15:47.219525 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216784    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 15:15:47.220005 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216788    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 15:15:47.220005 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216792    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 15:15:47.220005 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216795    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 15:15:47.220005 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216798    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 15:15:47.220005 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216801    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 15:15:47.220005 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216805    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 15:15:47.220005 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216809    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 15:15:47.220005 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216812    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 15:15:47.220005 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216815    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 15:15:47.220005 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216818    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 15:15:47.220005 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216820    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 15:15:47.220005 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216823    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 15:15:47.220005 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216825    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 15:15:47.220005 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216828    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 15:15:47.220005 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216831    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 15:15:47.220005 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216834    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 15:15:47.220005 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216836    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 15:15:47.220005 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216839    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 15:15:47.220005 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216842    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 15:15:47.220475 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.216844    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 15:15:47.220475 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217278    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 15:15:47.220475 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217285    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 15:15:47.220475 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217288    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 15:15:47.220475 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217291    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 15:15:47.220475 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217294    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 15:15:47.220475 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217297    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 15:15:47.220475 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217300    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 15:15:47.220475 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217302    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 15:15:47.220475 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217305    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 15:15:47.220475 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217308    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 15:15:47.220475 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217311    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 15:15:47.220475 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217313    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 15:15:47.220475 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217316    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 15:15:47.220475 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217319    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 15:15:47.220475 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217321    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 15:15:47.220475 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217325    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 15:15:47.220475 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217328    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 15:15:47.220475 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217330    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 15:15:47.220949 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217333    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 15:15:47.220949 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217336    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 15:15:47.220949 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217338    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 15:15:47.220949 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217341    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 15:15:47.220949 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217344    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 15:15:47.220949 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217346    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 15:15:47.220949 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217349    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 15:15:47.220949 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217352    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 15:15:47.220949 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217354    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 15:15:47.220949 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217357    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 15:15:47.220949 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217360    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 15:15:47.220949 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217362    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 15:15:47.220949 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217366    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 15:15:47.220949 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217369    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 15:15:47.220949 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217372    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 15:15:47.220949 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217374    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 15:15:47.220949 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217377    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 15:15:47.220949 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217380    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 15:15:47.220949 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217383    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 15:15:47.221452 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217385    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 15:15:47.221452 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217388    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 15:15:47.221452 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217390    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 15:15:47.221452 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217393    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 15:15:47.221452 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217396    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 15:15:47.221452 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217398    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 15:15:47.221452 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217401    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 15:15:47.221452 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217404    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 15:15:47.221452 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217406    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 15:15:47.221452 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217408    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 15:15:47.221452 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217415    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 15:15:47.221452 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217417    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 15:15:47.221452 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217420    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 15:15:47.221452 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217422    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 15:15:47.221452 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217425    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 15:15:47.221452 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217427    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 15:15:47.221452 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217430    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 15:15:47.221452 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217433    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 15:15:47.221452 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217436    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 15:15:47.221452 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217439    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 15:15:47.221950 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217441    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 15:15:47.221950 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217444    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 15:15:47.221950 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217446    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 15:15:47.221950 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217449    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 15:15:47.221950 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217451    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 15:15:47.221950 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217454    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 15:15:47.221950 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217456    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 15:15:47.221950 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217459    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 15:15:47.221950 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217462    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 15:15:47.221950 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217466    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 15:15:47.221950 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217470    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 15:15:47.221950 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217473    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 15:15:47.221950 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217476    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 15:15:47.221950 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217478    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 15:15:47.221950 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217481    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 15:15:47.221950 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217484    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 15:15:47.221950 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217486    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 15:15:47.221950 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217488    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 15:15:47.221950 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217491    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 15:15:47.221950 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217494    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 15:15:47.222510 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217496    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 15:15:47.222510 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217499    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 15:15:47.222510 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217504    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 15:15:47.222510 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217506    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 15:15:47.222510 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217509    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 15:15:47.222510 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217511    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 15:15:47.222510 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217514    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 15:15:47.222510 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217517    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 15:15:47.222510 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217519    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 15:15:47.222510 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217522    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 15:15:47.222510 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217524    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 15:15:47.222510 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217526    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 15:15:47.222510 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217529    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 15:15:47.222510 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217532    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 15:15:47.222510 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217534    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 15:15:47.222510 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217538    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 15:15:47.222510 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217541    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 15:15:47.222510 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217544    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 15:15:47.222510 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217546    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 15:15:47.222510 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217549    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217551    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.217554    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217624    2574 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217663    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217671    2574 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217675    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217682    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217686    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217690    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217694    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217697    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217701    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217704    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217708    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217714    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217716    2574 flags.go:64] FLAG: --cgroup-root=""
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217719    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217722    2574 flags.go:64] FLAG: --client-ca-file=""
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217725    2574 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217728    2574 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217732    2574 flags.go:64] FLAG: --cluster-domain=""
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217735    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217738    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 15:15:47.223058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217741    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217745    2574 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217749    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217751    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217754    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217758    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217761    2574 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217764    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217766    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217770    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217773    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217777    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217780    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217783    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217785    2574 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217788    2574 flags.go:64] FLAG: --enable-server="true"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217791    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217796    2574 flags.go:64] FLAG: --event-burst="100"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217799    2574 flags.go:64] FLAG: --event-qps="50"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217802    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217805    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217808    2574 flags.go:64] FLAG: --eviction-hard=""
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217812    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217817    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217820    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 15:15:47.223647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217823    2574 flags.go:64] FLAG: --eviction-soft=""
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217826    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217829    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217832    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217834    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217838    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217841    2574 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217843    2574 flags.go:64] FLAG: --feature-gates=""
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217847    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217850    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217853    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217856    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217859    2574 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217862    2574 flags.go:64] FLAG: --help="false"
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217865    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-142-37.ec2.internal"
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217868    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217871    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217874    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217877    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217880    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217883    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217886    2574 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217889    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 15:15:47.224261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217892    2574 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217894    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217897    2574 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217900    2574 flags.go:64] FLAG: --kube-reserved=""
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217903    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217906    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217909    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217914    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217917    2574 flags.go:64] FLAG: --lock-file=""
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217920    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217923    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217938    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217943    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217947    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217950    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217953    2574 flags.go:64] FLAG: --logging-format="text"
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217956    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217959    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217962    2574 flags.go:64] FLAG: --manifest-url=""
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217965    2574 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217969    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217972    2574 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217976    2574 flags.go:64] FLAG: --max-pods="110"
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217979    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217982    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 15:15:47.224850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217985    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217988    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217991    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217994    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.217997    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218004    2574 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218007    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218010    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218013    2574 flags.go:64] FLAG: --pod-cidr=""
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218016    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218021    2574 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218024    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218027    2574 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218030    2574 flags.go:64] FLAG: --port="10250"
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218035    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218040    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c773296001b60872"
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218043    2574 flags.go:64] FLAG: --qos-reserved=""
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218046    2574 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218049    2574 flags.go:64] FLAG: --register-node="true"
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218052    2574 flags.go:64] FLAG: --register-with-taints=""
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218056    2574 flags.go:64] FLAG: --registry-burst="10"
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218059    2574 flags.go:64] FLAG: --registry-qps="5"
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218062    2574 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218065    2574 flags.go:64] FLAG: --reserved-memory=""
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218069    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 15:15:47.225491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218071    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218074    2574 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218077    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218080    2574 flags.go:64] FLAG: --runonce="false"
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218083    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218086    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218090    2574 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218093    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218096    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218099    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218102    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218105    2574 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218108    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218111    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218113    2574 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218116    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218119    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218122    2574 flags.go:64] FLAG: --system-cgroups=""
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218125    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218130    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218133    2574 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218137    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218142    2574 flags.go:64] FLAG: --tls-min-version=""
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218145    2574 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218148    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 15:15:47.226402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218151    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 15:15:47.227147 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218154    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 15:15:47.227147 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218157    2574 flags.go:64] FLAG: --v="2"
Sep 10 15:15:47.227147 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218161    2574 flags.go:64] FLAG: --version="false"
Sep 10 15:15:47.227147 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218165    2574 flags.go:64] FLAG: --vmodule=""
Sep 10 15:15:47.227147 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218168    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 15:15:47.227147 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.218172    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 15:15:47.227147 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218284    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 15:15:47.227147 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218287    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 15:15:47.227147 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218290    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 15:15:47.227147 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218293    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 15:15:47.227147 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218296    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 15:15:47.227147 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218299    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 15:15:47.227147 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218303    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 15:15:47.227147 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218307    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 15:15:47.227147 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218310    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 15:15:47.227147 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218313    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 15:15:47.227147 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218316    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 15:15:47.227147 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218318    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 15:15:47.227147 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218321    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 15:15:47.227147 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218323    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 15:15:47.227147 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218326    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 15:15:47.227679 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218328    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 15:15:47.227679 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218331    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 15:15:47.227679 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218334    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 15:15:47.227679 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218336    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 15:15:47.227679 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218339    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 15:15:47.227679 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218341    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 15:15:47.227679 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218347    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 15:15:47.227679 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218352    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 15:15:47.227679 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218356    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 15:15:47.227679 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218362    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 15:15:47.227679 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218366    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 15:15:47.227679 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218369    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 15:15:47.227679 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218372    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 15:15:47.227679 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218375    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 15:15:47.227679 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218377    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 15:15:47.227679 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218380    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 15:15:47.227679 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218383    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 15:15:47.227679 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218385    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 15:15:47.227679 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218388    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 15:15:47.228181 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218390    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 15:15:47.228181 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218393    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 15:15:47.228181 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218396    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 15:15:47.228181 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218398    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 15:15:47.228181 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218401    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 15:15:47.228181 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218403    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 15:15:47.228181 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218413    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 15:15:47.228181 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218416    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 15:15:47.228181 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218418    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 15:15:47.228181 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218421    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 15:15:47.228181 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218424    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 15:15:47.228181 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218427    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 15:15:47.228181 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218429    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 15:15:47.228181 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218432    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 15:15:47.228181 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218435    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 15:15:47.228181 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218437    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 15:15:47.228181 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218439    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 15:15:47.228181 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218442    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 15:15:47.228181 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218445    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 15:15:47.228181 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218449    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 15:15:47.228671 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218453    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 15:15:47.228671 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218456    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 15:15:47.228671 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218458    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 15:15:47.228671 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218461    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 15:15:47.228671 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218464    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 15:15:47.228671 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218467    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 15:15:47.228671 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218469    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 15:15:47.228671 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218472    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 15:15:47.228671 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218474    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 15:15:47.228671 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218477    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 15:15:47.228671 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218480    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 15:15:47.228671 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218482    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 15:15:47.228671 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218485    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 15:15:47.228671 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218487    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 15:15:47.228671 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218490    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 15:15:47.228671 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218493    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 15:15:47.228671 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218495    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 15:15:47.228671 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218498    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 15:15:47.228671 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218500    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 15:15:47.228671 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218503    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 15:15:47.229265 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218505    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 15:15:47.229265 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218508    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 15:15:47.229265 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218511    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 15:15:47.229265 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218514    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 15:15:47.229265 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218516    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 15:15:47.229265 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218518    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 15:15:47.229265 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218521    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 15:15:47.229265 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218524    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 15:15:47.229265 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218526    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 15:15:47.229265 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218529    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 15:15:47.229265 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218531    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 15:15:47.229265 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218535    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 15:15:47.229265 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218539    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 15:15:47.229265 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218542    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 15:15:47.229265 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218545    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 15:15:47.229265 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218547    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 15:15:47.229265 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218550    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 15:15:47.229265 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218552    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 15:15:47.229265 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218555    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 15:15:47.229265 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218557    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 15:15:47.229757 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218560    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 15:15:47.229757 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218563    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 15:15:47.229757 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218565    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 15:15:47.229757 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218568    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 15:15:47.229757 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.218571    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 15:15:47.229757 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.219114    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 15:15:47.229757 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.227656    2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 15:15:47.229757 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.227671    2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 15:15:47.229757 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.228373    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 15:15:47.229757 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.228384    2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 15:15:47.229757 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228440    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 15:15:47.229757 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228444    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 15:15:47.229757 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228448    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 15:15:47.229757 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228451    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 15:15:47.229757 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228454    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 15:15:47.230144 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228458    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 15:15:47.230144 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228460    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 15:15:47.230144 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228464    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 15:15:47.230144 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228466    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 15:15:47.230144 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228469    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 15:15:47.230144 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228472    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 15:15:47.230144 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228474    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 15:15:47.230144 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228477    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 15:15:47.230144 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228480    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 15:15:47.230144 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228482    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 15:15:47.230144 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228485    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 15:15:47.230144 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228488    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 15:15:47.230144 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228490    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 15:15:47.230144 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228493    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 15:15:47.230144 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228495    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 15:15:47.230144 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228498    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 15:15:47.230144 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228502    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 15:15:47.230144 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228504    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 15:15:47.230144 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228507    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 15:15:47.230642 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228511    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 15:15:47.230642 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228514    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 15:15:47.230642 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228517    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 15:15:47.230642 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228520    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 15:15:47.230642 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228523    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 15:15:47.230642 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228527    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 15:15:47.230642 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228530    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 15:15:47.230642 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228533    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 15:15:47.230642 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228536    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 15:15:47.230642 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228539    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 15:15:47.230642 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228542    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 15:15:47.230642 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228544    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 15:15:47.230642 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228547    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 15:15:47.230642 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228550    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 15:15:47.230642 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228552    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 15:15:47.230642 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228555    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 15:15:47.230642 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228558    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 15:15:47.230642 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228561    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 15:15:47.230642 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228563    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 15:15:47.230642 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228566    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 15:15:47.231136 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228569    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 15:15:47.231136 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228571    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 15:15:47.231136 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228574    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 15:15:47.231136 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228576    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 15:15:47.231136 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228579    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 15:15:47.231136 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228581    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 15:15:47.231136 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228584    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 15:15:47.231136 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228587    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 15:15:47.231136 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228589    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 15:15:47.231136 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228592    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 15:15:47.231136 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228595    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 15:15:47.231136 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228597    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 15:15:47.231136 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228600    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 15:15:47.231136 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228602    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 15:15:47.231136 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228605    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 15:15:47.231136 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228607    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 15:15:47.231136 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228610    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 15:15:47.231136 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228613    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 15:15:47.231136 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228616    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 15:15:47.231136 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228619    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 15:15:47.231623 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228621    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 15:15:47.231623 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228624    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 15:15:47.231623 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228627    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 15:15:47.231623 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228629    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 15:15:47.231623 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228632    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 15:15:47.231623 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228635    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 15:15:47.231623 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228637    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 15:15:47.231623 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228640    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 15:15:47.231623 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228642    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 15:15:47.231623 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228646    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 15:15:47.231623 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228650    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 15:15:47.231623 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228653    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 15:15:47.231623 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228656    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 15:15:47.231623 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228659    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 15:15:47.231623 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228663    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 15:15:47.231623 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228666    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 15:15:47.231623 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228669    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 15:15:47.231623 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228673    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 15:15:47.231623 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228677    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 15:15:47.232107 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228681    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 15:15:47.232107 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228684    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 15:15:47.232107 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228687    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 15:15:47.232107 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228691    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 15:15:47.232107 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228693    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 15:15:47.232107 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228696    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 15:15:47.232107 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228700    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 15:15:47.232107 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228702    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 15:15:47.232107 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228705    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 15:15:47.232107 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228708    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 15:15:47.232107 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228711    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 15:15:47.232107 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228714    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 15:15:47.232107 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228717    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 15:15:47.232107 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228720    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 15:15:47.232107 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228722    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 15:15:47.232107 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228725    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 15:15:47.232503 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.228731    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 15:15:47.232503 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228874    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 15:15:47.232503 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228879    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 15:15:47.232503 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228882    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 15:15:47.232503 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228885    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 15:15:47.232503 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228888    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 15:15:47.232503 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228892    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 15:15:47.232503 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228895    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 15:15:47.232503 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228897    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 15:15:47.232503 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228900    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 15:15:47.232503 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228903    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 15:15:47.232503 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228905    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 15:15:47.232503 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228908    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 15:15:47.232503 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228911    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 15:15:47.232503 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228914    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 15:15:47.232869 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228917    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 15:15:47.232869 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228919    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 15:15:47.232869 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228922    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 15:15:47.232869 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228940    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 15:15:47.232869 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228944    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 15:15:47.232869 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228947    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 15:15:47.232869 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228949    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 15:15:47.232869 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228952    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 15:15:47.232869 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228955    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 15:15:47.232869 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228958    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 15:15:47.232869 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228961    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 15:15:47.232869 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228963    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 15:15:47.232869 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228966    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 15:15:47.232869 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228968    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 15:15:47.232869 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228971    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 15:15:47.232869 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228974    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 15:15:47.232869 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228976    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 15:15:47.232869 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228979    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 15:15:47.232869 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228982    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 15:15:47.232869 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228985    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 15:15:47.233384 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228987    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 15:15:47.233384 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228990    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 15:15:47.233384 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228992    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 15:15:47.233384 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228995    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 15:15:47.233384 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.228997    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 15:15:47.233384 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229000    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 15:15:47.233384 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229002    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 15:15:47.233384 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229005    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 15:15:47.233384 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229007    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 15:15:47.233384 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229010    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 15:15:47.233384 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229012    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 15:15:47.233384 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229016    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 15:15:47.233384 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229018    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 15:15:47.233384 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229021    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 15:15:47.233384 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229024    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 15:15:47.233384 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229026    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 15:15:47.233384 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229030    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 15:15:47.233384 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229035    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 15:15:47.233384 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229038    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 15:15:47.233384 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229041    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 15:15:47.233857 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229043    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 15:15:47.233857 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229046    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 15:15:47.233857 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229049    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 15:15:47.233857 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229052    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 15:15:47.233857 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229055    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 15:15:47.233857 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229057    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 15:15:47.233857 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229060    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 15:15:47.233857 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229062    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 15:15:47.233857 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229065    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 15:15:47.233857 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229067    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 15:15:47.233857 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229070    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 15:15:47.233857 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229072    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 15:15:47.233857 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229075    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 15:15:47.233857 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229078    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 15:15:47.233857 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229080    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 15:15:47.233857 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229083    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 15:15:47.233857 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229085    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 15:15:47.233857 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229089    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 15:15:47.233857 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229092    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 15:15:47.234332 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229095    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 15:15:47.234332 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229098    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 15:15:47.234332 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229101    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 15:15:47.234332 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229103    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 15:15:47.234332 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229106    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 15:15:47.234332 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229109    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 15:15:47.234332 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229118    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 15:15:47.234332 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229122    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 15:15:47.234332 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229125    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 15:15:47.234332 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229129    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 15:15:47.234332 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229133    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 15:15:47.234332 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229135    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 15:15:47.234332 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229139    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 15:15:47.234332 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229142    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 15:15:47.234332 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229145    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 15:15:47.234332 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229147    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 15:15:47.234332 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229150    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 15:15:47.234332 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229152    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 15:15:47.234332 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229155    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 15:15:47.234332 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229158    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 15:15:47.234810 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229160    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 15:15:47.234810 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229163    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 15:15:47.234810 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229165    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 15:15:47.234810 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229168    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 15:15:47.234810 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229170    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 15:15:47.234810 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:47.229173    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 15:15:47.234810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.229178    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 15:15:47.234810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.229277    2574 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 15:15:47.234810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.231747    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 15:15:47.234810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.232671    2574 server.go:1019] "Starting client certificate rotation"
Sep 10 15:15:47.234810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.232770    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 15:15:47.234810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.232799    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 15:15:47.235695 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.235680    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 15:15:47.236822 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.236803    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 15:15:47.245688 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.245671    2574 log.go:25] "Validated CRI v1 runtime API"
Sep 10 15:15:47.248567 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.248551    2574 log.go:25] "Validated CRI v1 image API"
Sep 10 15:15:47.249505 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.249489    2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 15:15:47.252619 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.252601    2574 fs.go:135] Filesystem UUIDs: map[10b0e18a-c71a-475f-bb4f-a2a2c2e29530:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8b8d51b0-4ed0-48c2-84d0-dae514ac93bd:/dev/nvme0n1p3]
Sep 10 15:15:47.252691 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.252618    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 15:15:47.258315 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.258213    2574 manager.go:216] Machine: {Timestamp:2026-09-10 15:15:47.256956785 +0000 UTC m=+0.306755299 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102666 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23469a40d7e0a90f5c7c27990b38e8 SystemUUID:ec23469a-40d7-e0a9-0f5c-7c27990b38e8 BootID:36ca28d7-e875-465f-b35d-227d42796e6f Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fb:c2:dc:b6:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fb:c2:dc:b6:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:32:7d:55:ef:14 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 15:15:47.258315 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.258306    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 15:15:47.258423 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.258379    2574 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 15:15:47.263006 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.262979    2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 15:15:47.263174 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.263012    2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-37.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 15:15:47.263727 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.263714    2574 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 15:15:47.263785 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.263734    2574 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 15:15:47.263785 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.263744    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 15:15:47.264297 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.264285    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 15:15:47.264816 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.264799    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 15:15:47.265528 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.265514    2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 15:15:47.269872 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.269857    2574 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 15:15:47.270030 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.270018    2574 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 15:15:47.270100 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.270056    2574 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 15:15:47.270100 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.270070    2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 15:15:47.270100 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.270091    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 15:15:47.270222 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.270106    2574 kubelet.go:398] "Adding apiserver pod source"
Sep 10 15:15:47.270222 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.270119    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 15:15:47.270552 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.270533    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 15:15:47.270668 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.270558    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 15:15:47.273527 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.273513    2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 15:15:47.275784 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.275770    2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 15:15:47.275822 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.275801    2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 15:15:47.275979 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.275968    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 15:15:47.276018 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.275984    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 15:15:47.276018 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.275991    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 15:15:47.276018 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.275997    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 15:15:47.276018 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.276005    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 15:15:47.276018 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.276010    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 15:15:47.276602 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.276594    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 15:15:47.276638 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.276602    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 15:15:47.276638 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.276609    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 15:15:47.276638 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.276614    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 15:15:47.276638 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.276622    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 15:15:47.276638 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.276631    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 15:15:47.278002 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.277989    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 15:15:47.278002 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.278002    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 15:15:47.280703 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.280645    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-37.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 15:15:47.280703 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:47.280688    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 15:15:47.280806 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:47.280749    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 15:15:47.282222 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.282206    2574 server.go:1268] "Started kubelet"
Sep 10 15:15:47.282329 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.282274    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 15:15:47.282383 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.282296    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 15:15:47.282383 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.282365    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 15:15:47.283307 ip-10-0-142-37 systemd[1]: Started Kubernetes Kubelet.
Sep 10 15:15:47.285150 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.284040    2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 15:15:47.285150 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.284899    2574 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 15:15:47.288952 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:47.286446    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-37.ec2.internal.18d3fe8a60fa424a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-37.ec2.internal,UID:ip-10-0-142-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-37.ec2.internal,},FirstTimestamp:2026-09-10 15:15:47.282174538 +0000 UTC m=+0.331973039,LastTimestamp:2026-09-10 15:15:47.282174538 +0000 UTC m=+0.331973039,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-37.ec2.internal,}"
Sep 10 15:15:47.288952 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:47.288405    2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 15:15:47.289131 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.289100    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 15:15:47.289578 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.289556    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 15:15:47.289711 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:47.289694    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-37.ec2.internal\" not found"
Sep 10 15:15:47.290432 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.290404    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 15:15:47.290524 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.290406    2574 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 15:15:47.290524 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.290451    2574 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 15:15:47.290621 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.290551    2574 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 15:15:47.290621 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.290558    2574 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 15:15:47.290701 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.290651    2574 factory.go:153] Registering CRI-O factory
Sep 10 15:15:47.290701 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.290688    2574 factory.go:223] Registration of the crio container factory successfully
Sep 10 15:15:47.290779 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.290725    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 15:15:47.290779 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.290733    2574 factory.go:55] Registering systemd factory
Sep 10 15:15:47.290779 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.290738    2574 factory.go:223] Registration of the systemd container factory successfully
Sep 10 15:15:47.290779 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.290749    2574 factory.go:103] Registering Raw factory
Sep 10 15:15:47.290779 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.290759    2574 manager.go:1196] Started watching for new ooms in manager
Sep 10 15:15:47.291156 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.291142    2574 manager.go:349] Starting recovery of all containers
Sep 10 15:15:47.291760 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.291738    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zlvbp"
Sep 10 15:15:47.297683 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.297632    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zlvbp"
Sep 10 15:15:47.301100 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:47.301071    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 15:15:47.301100 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:47.301081    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 15:15:47.302541 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.302524    2574 manager.go:354] Recovery completed
Sep 10 15:15:47.306745 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.306633    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 15:15:47.308394 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.308378    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 15:15:47.308475 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.308406    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 15:15:47.308475 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.308419    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeHasSufficientPID"
Sep 10 15:15:47.309000 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.308981    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 15:15:47.309000 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.308999    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 15:15:47.309110 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.309009    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 15:15:47.309110 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.309015    2574 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 15:15:47.309784 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.309772    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 15:15:47.309820 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.309797    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 15:15:47.309820 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.309809    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeHasSufficientPID"
Sep 10 15:15:47.311227 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.311216    2574 policy_none.go:49] "None policy: Start"
Sep 10 15:15:47.311276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.311231    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 15:15:47.311276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.311241    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 15:15:47.313191 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.313179    2574 policy_none.go:47] "Start"
Sep 10 15:15:47.343534 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.343519    2574 manager.go:337] "Starting Device Plugin manager"
Sep 10 15:15:47.343640 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:47.343564    2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 15:15:47.343640 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.343577    2574 server.go:87] "Starting device plugin registration server"
Sep 10 15:15:47.343901 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.343886    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 15:15:47.344015 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.343901    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 15:15:47.344147 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.344127    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 15:15:47.344220 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.344202    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 15:15:47.344220 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.344210    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 15:15:47.344666 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:47.344645    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 15:15:47.344790 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:47.344706    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-37.ec2.internal\" not found"
Sep 10 15:15:47.401250 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.401201    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 15:15:47.403243 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.402429    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 15:15:47.403243 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.402476    2574 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 15:15:47.403243 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.402505    2574 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 15:15:47.403243 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:47.402602    2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 15:15:47.405043 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.405025    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 15:15:47.444136 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.444117    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 15:15:47.445463 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.445444    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 15:15:47.445576 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.445481    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 15:15:47.445576 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.445496    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeHasSufficientPID"
Sep 10 15:15:47.445576 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.445525    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-37.ec2.internal"
Sep 10 15:15:47.454021 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.453996    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-37.ec2.internal"
Sep 10 15:15:47.454021 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:47.454018    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-37.ec2.internal\": node \"ip-10-0-142-37.ec2.internal\" not found"
Sep 10 15:15:47.474487 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:47.474416    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-37.ec2.internal\" not found"
Sep 10 15:15:47.503688 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.503662    2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-37.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-37.ec2.internal"]
Sep 10 15:15:47.503760 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.503726    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 15:15:47.505303 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.505287    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 15:15:47.505399 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.505316    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 15:15:47.505399 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.505326    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeHasSufficientPID"
Sep 10 15:15:47.507282 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.507270    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 15:15:47.507409 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.507395    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-37.ec2.internal"
Sep 10 15:15:47.507451 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.507423    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 15:15:47.508005 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.507990    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 15:15:47.508005 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.507991    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 15:15:47.508113 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.508018    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 15:15:47.508113 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.508032    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeHasSufficientPID"
Sep 10 15:15:47.508113 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.508035    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 15:15:47.508113 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.508045    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeHasSufficientPID"
Sep 10 15:15:47.510094 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.510079    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-37.ec2.internal"
Sep 10 15:15:47.510166 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.510103    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 15:15:47.510697 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.510680    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 15:15:47.510761 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.510706    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 15:15:47.510761 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.510723    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeHasSufficientPID"
Sep 10 15:15:47.539527 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:47.539508    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-37.ec2.internal\" not found" node="ip-10-0-142-37.ec2.internal"
Sep 10 15:15:47.543995 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:47.543976    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-37.ec2.internal\" not found" node="ip-10-0-142-37.ec2.internal"
Sep 10 15:15:47.574840 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:47.574822    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-37.ec2.internal\" not found"
Sep 10 15:15:47.675674 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:47.675631    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-37.ec2.internal\" not found"
Sep 10 15:15:47.691925 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.691899    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4a9dcbb4f6971a42593aebbbeaf48432-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-37.ec2.internal\" (UID: \"4a9dcbb4f6971a42593aebbbeaf48432\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-37.ec2.internal"
Sep 10 15:15:47.692008 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.691942    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a9dcbb4f6971a42593aebbbeaf48432-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-37.ec2.internal\" (UID: \"4a9dcbb4f6971a42593aebbbeaf48432\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-37.ec2.internal"
Sep 10 15:15:47.692008 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.691961    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7145b012af55e41dcb0c2a41a9ae7904-config\") pod \"kube-apiserver-proxy-ip-10-0-142-37.ec2.internal\" (UID: \"7145b012af55e41dcb0c2a41a9ae7904\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-37.ec2.internal"
Sep 10 15:15:47.776364 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:47.776298    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-37.ec2.internal\" not found"
Sep 10 15:15:47.792681 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.792653    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7145b012af55e41dcb0c2a41a9ae7904-config\") pod \"kube-apiserver-proxy-ip-10-0-142-37.ec2.internal\" (UID: \"7145b012af55e41dcb0c2a41a9ae7904\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-37.ec2.internal"
Sep 10 15:15:47.792788 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.792690    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4a9dcbb4f6971a42593aebbbeaf48432-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-37.ec2.internal\" (UID: \"4a9dcbb4f6971a42593aebbbeaf48432\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-37.ec2.internal"
Sep 10 15:15:47.792788 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.792716    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a9dcbb4f6971a42593aebbbeaf48432-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-37.ec2.internal\" (UID: \"4a9dcbb4f6971a42593aebbbeaf48432\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-37.ec2.internal"
Sep 10 15:15:47.792788 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.792749    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4a9dcbb4f6971a42593aebbbeaf48432-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-37.ec2.internal\" (UID: \"4a9dcbb4f6971a42593aebbbeaf48432\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-37.ec2.internal"
Sep 10 15:15:47.792788 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.792749    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7145b012af55e41dcb0c2a41a9ae7904-config\") pod \"kube-apiserver-proxy-ip-10-0-142-37.ec2.internal\" (UID: \"7145b012af55e41dcb0c2a41a9ae7904\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-37.ec2.internal"
Sep 10 15:15:47.792922 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.792750    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a9dcbb4f6971a42593aebbbeaf48432-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-37.ec2.internal\" (UID: \"4a9dcbb4f6971a42593aebbbeaf48432\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-37.ec2.internal"
Sep 10 15:15:47.842806 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.842775    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-37.ec2.internal"
Sep 10 15:15:47.846329 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:47.846299    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-37.ec2.internal"
Sep 10 15:15:47.876731 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:47.876698    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-37.ec2.internal\" not found"
Sep 10 15:15:47.977214 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:47.977165    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-37.ec2.internal\" not found"
Sep 10 15:15:48.077712 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:48.077669    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-37.ec2.internal\" not found"
Sep 10 15:15:48.178143 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:48.178117    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-37.ec2.internal\" not found"
Sep 10 15:15:48.232619 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:48.232588    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 15:15:48.233105 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:48.232794    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 15:15:48.278986 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:48.278960    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-37.ec2.internal\" not found"
Sep 10 15:15:48.301307 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:48.301273    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 15:10:47 +0000 UTC" deadline="2028-04-27 20:42:11.573098467 +0000 UTC"
Sep 10 15:15:48.301307 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:48.301298    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14285h26m23.271803594s"
Sep 10 15:15:48.379444 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:48.379409    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-37.ec2.internal\" not found"
Sep 10 15:15:48.423520 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:48.423491    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 15:15:48.479497 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:48.479470    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-37.ec2.internal\" not found"
Sep 10 15:15:48.480195 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:48.480180    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 15:15:48.484762 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:48.484736    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7145b012af55e41dcb0c2a41a9ae7904.slice/crio-017a6f3beba5f61f7867b192713d097acd18415ef7a4b35a1ab9b4b561f7d63d WatchSource:0}: Error finding container 017a6f3beba5f61f7867b192713d097acd18415ef7a4b35a1ab9b4b561f7d63d: Status 404 returned error can't find the container with id 017a6f3beba5f61f7867b192713d097acd18415ef7a4b35a1ab9b4b561f7d63d
Sep 10 15:15:48.486861 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:48.485702    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a9dcbb4f6971a42593aebbbeaf48432.slice/crio-21359c690651e055c5073912fb8a28558c80dcdeb2e798042ad3b3608e5391b4 WatchSource:0}: Error finding container 21359c690651e055c5073912fb8a28558c80dcdeb2e798042ad3b3608e5391b4: Status 404 returned error can't find the container with id 21359c690651e055c5073912fb8a28558c80dcdeb2e798042ad3b3608e5391b4
Sep 10 15:15:48.490063 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:48.490040    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-37.ec2.internal"
Sep 10 15:15:48.491131 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:48.491116    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 15:15:48.506253 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:48.506234    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 15:15:48.507273 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:48.507260    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-37.ec2.internal"
Sep 10 15:15:48.529239 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:48.529219    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 15:15:48.841778 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:48.841700    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 15:15:49.108240 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.108153    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 15:15:49.271559 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.271518    2574 apiserver.go:52] "Watching apiserver"
Sep 10 15:15:49.281587 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.281559    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 15:15:49.282715 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.282683    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-cd4sl","kube-system/global-pull-secret-syncer-9qzxr","kube-system/kube-apiserver-proxy-ip-10-0-142-37.ec2.internal","openshift-cluster-node-tuning-operator/tuned-sm8v7","openshift-dns/node-resolver-bj7vg","openshift-image-registry/node-ca-9ctw2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-37.ec2.internal","openshift-multus/multus-additional-cni-plugins-hxnt8","openshift-multus/multus-c2rmh","kube-system/konnectivity-agent-tm2gm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt","openshift-multus/network-metrics-daemon-s87zw","openshift-network-diagnostics/network-check-target-jfhkb","openshift-network-operator/iptables-alerter-n4hgt"]
Sep 10 15:15:49.285250 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.285230    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tm2gm"
Sep 10 15:15:49.287490 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.287465    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:15:49.287575 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:49.287546    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhkb" podUID="17387da0-5265-4e58-9383-ccc3e8cbf5ea"
Sep 10 15:15:49.288226 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.288202    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 15:15:49.288315 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.288254    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 15:15:49.288379 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.288343    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f4mcd\""
Sep 10 15:15:49.289838 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.289817    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 15:15:49.291318 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.290793    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n4hgt"
Sep 10 15:15:49.291918 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.291899    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.293554 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.293524    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9pct9\""
Sep 10 15:15:49.293737 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.293721    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 15:15:49.294073 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.294056    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 15:15:49.294209 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.294189    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 15:15:49.294256 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.294243    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 15:15:49.294996 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.294553    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bj7vg"
Sep 10 15:15:49.294996 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.294674    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 15:15:49.294996 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.294756    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m2w42\""
Sep 10 15:15:49.296910 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.296890    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 15:15:49.297219 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.297203    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hf496\""
Sep 10 15:15:49.297424 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.297408    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 15:15:49.297880 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.297866    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9ctw2"
Sep 10 15:15:49.299155 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.299137    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.300411 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300387    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcgwn\" (UniqueName: \"kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn\") pod \"network-check-target-jfhkb\" (UID: \"17387da0-5265-4e58-9383-ccc3e8cbf5ea\") " pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:15:49.300503 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300423    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53f7663e-7918-49a1-a518-841a4119398c-host-slash\") pod \"iptables-alerter-n4hgt\" (UID: \"53f7663e-7918-49a1-a518-841a4119398c\") " pod="openshift-network-operator/iptables-alerter-n4hgt"
Sep 10 15:15:49.300503 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300449    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-var-lib-kubelet\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.300503 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300472    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st8tn\" (UniqueName: \"kubernetes.io/projected/3de18da0-a224-4960-998d-145e892f0916-kube-api-access-st8tn\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.300655 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300501    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/53f7663e-7918-49a1-a518-841a4119398c-iptables-alerter-script\") pod \"iptables-alerter-n4hgt\" (UID: \"53f7663e-7918-49a1-a518-841a4119398c\") " pod="openshift-network-operator/iptables-alerter-n4hgt"
Sep 10 15:15:49.300655 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300525    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-etc-sysctl-d\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.300655 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300546    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-run\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.300655 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300566    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-lib-modules\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.300655 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300587    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a965c17d-32ee-4814-8067-df4b73b8ea0a-konnectivity-ca\") pod \"konnectivity-agent-tm2gm\" (UID: \"a965c17d-32ee-4814-8067-df4b73b8ea0a\") " pod="kube-system/konnectivity-agent-tm2gm"
Sep 10 15:15:49.300655 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300611    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-etc-modprobe-d\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.300655 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300633    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-etc-sysconfig\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.300655 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300655    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-etc-kubernetes\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.301046 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300675    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-sys\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.301046 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300696    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-host\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.301046 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300699    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 15:15:49.301046 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300718    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a965c17d-32ee-4814-8067-df4b73b8ea0a-agent-certs\") pod \"konnectivity-agent-tm2gm\" (UID: \"a965c17d-32ee-4814-8067-df4b73b8ea0a\") " pod="kube-system/konnectivity-agent-tm2gm"
Sep 10 15:15:49.301046 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300732    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 15:15:49.301046 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300740    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96nsj\" (UniqueName: \"kubernetes.io/projected/53f7663e-7918-49a1-a518-841a4119398c-kube-api-access-96nsj\") pod \"iptables-alerter-n4hgt\" (UID: \"53f7663e-7918-49a1-a518-841a4119398c\") " pod="openshift-network-operator/iptables-alerter-n4hgt"
Sep 10 15:15:49.301046 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300775    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-etc-sysctl-conf\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.301046 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300799    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-etc-systemd\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.301046 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300824    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3de18da0-a224-4960-998d-145e892f0916-etc-tuned\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.301046 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300846    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3de18da0-a224-4960-998d-145e892f0916-tmp\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.301046 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.300983    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 15:15:49.301046 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.301032    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 15:15:49.301569 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.301136    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fq8tg\""
Sep 10 15:15:49.301569 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.301369    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 15:15:49.302306 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.302272    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 15:15:49.302530 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.302510    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.303861 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.303166    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k98s5\""
Sep 10 15:15:49.303861 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.303495    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 15:15:49.303983 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.303865    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 15:15:49.305451 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.305432    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 15:15:49.305918 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.305882    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-brv7s\""
Sep 10 15:15:49.307430 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.306390    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 15:15:49.307549 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.307518    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:15:49.307620 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:49.307597    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qzxr" podUID="8bd848e3-5919-4d0a-80c9-f2bd7f7db58b"
Sep 10 15:15:49.309984 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.309963    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.313736 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.313107    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.313826 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.313754    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pqmdk\""
Sep 10 15:15:49.313826 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.313798    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 15:15:49.313962 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.313838    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 15:15:49.314019 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.313961    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 15:15:49.314086 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.314069    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 15:15:49.314237 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.314217    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 15:15:49.314237 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.314233    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 15:15:49.315161 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.315132    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:15:49.315250 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:49.315200    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s87zw" podUID="dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc"
Sep 10 15:15:49.316685 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.316658    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-z9l6k\""
Sep 10 15:15:49.316769 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.316725    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 15:15:49.316828 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.316780    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 15:15:49.317135 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.317000    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 15:15:49.326358 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.326338    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6w6sk"
Sep 10 15:15:49.334730 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.334711    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6w6sk"
Sep 10 15:15:49.391730 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.391704    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 15:15:49.401386 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.401359    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-multus-cni-dir\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.401542 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.401395    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-host-run-multus-certs\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.401542 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.401423    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-host-slash\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.401542 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.401450    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96nsj\" (UniqueName: \"kubernetes.io/projected/53f7663e-7918-49a1-a518-841a4119398c-kube-api-access-96nsj\") pod \"iptables-alerter-n4hgt\" (UID: \"53f7663e-7918-49a1-a518-841a4119398c\") " pod="openshift-network-operator/iptables-alerter-n4hgt"
Sep 10 15:15:49.401542 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.401491    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-etc-sysctl-conf\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.401737 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.401555    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-etc-systemd\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.401737 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.401581    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6065b3cf-3d6f-4d96-b5f1-86e5193a42da-sys-fs\") pod \"aws-ebs-csi-driver-node-wvktt\" (UID: \"6065b3cf-3d6f-4d96-b5f1-86e5193a42da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.401737 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.401599    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-host-run-netns\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.401737 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.401616    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-run-ovn\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.401737 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.401642    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcgwn\" (UniqueName: \"kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn\") pod \"network-check-target-jfhkb\" (UID: \"17387da0-5265-4e58-9383-ccc3e8cbf5ea\") " pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:15:49.401737 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.401641    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-etc-sysctl-conf\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.401737 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.401691    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7ffe6a3-b6d6-4481-b023-95ad5eae05fc-serviceca\") pod \"node-ca-9ctw2\" (UID: \"a7ffe6a3-b6d6-4481-b023-95ad5eae05fc\") " pod="openshift-image-registry/node-ca-9ctw2"
Sep 10 15:15:49.401737 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.401695    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-etc-systemd\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.401737 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.401717    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-etc-kubernetes\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.402235 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.401758    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-host-run-ovn-kubernetes\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.402235 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.401795    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-host-cni-bin\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.402235 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.401848    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e265d02-f5f7-4c23-9d76-a93bcd720de2-cni-binary-copy\") pod \"multus-additional-cni-plugins-hxnt8\" (UID: \"1e265d02-f5f7-4c23-9d76-a93bcd720de2\") " pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.402235 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.401877    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-dbus\") pod \"global-pull-secret-syncer-9qzxr\" (UID: \"8bd848e3-5919-4d0a-80c9-f2bd7f7db58b\") " pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:15:49.402235 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.401902    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6065b3cf-3d6f-4d96-b5f1-86e5193a42da-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wvktt\" (UID: \"6065b3cf-3d6f-4d96-b5f1-86e5193a42da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.402235 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.401944    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9486873e-4c69-4b47-b22b-7e820e7d2ce1-multus-daemon-config\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.402235 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.401979    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs\") pod \"network-metrics-daemon-s87zw\" (UID: \"dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc\") " pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:15:49.402235 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402032    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-host\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.402235 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402060    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h54f6\" (UniqueName: \"kubernetes.io/projected/4ba47f2c-aa01-49e8-8b3a-2534c01624a4-kube-api-access-h54f6\") pod \"node-resolver-bj7vg\" (UID: \"4ba47f2c-aa01-49e8-8b3a-2534c01624a4\") " pod="openshift-dns/node-resolver-bj7vg"
Sep 10 15:15:49.402235 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402085    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e265d02-f5f7-4c23-9d76-a93bcd720de2-cnibin\") pod \"multus-additional-cni-plugins-hxnt8\" (UID: \"1e265d02-f5f7-4c23-9d76-a93bcd720de2\") " pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.402235 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402124    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6065b3cf-3d6f-4d96-b5f1-86e5193a42da-socket-dir\") pod \"aws-ebs-csi-driver-node-wvktt\" (UID: \"6065b3cf-3d6f-4d96-b5f1-86e5193a42da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.402235 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402130    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-host\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.402235 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402146    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6065b3cf-3d6f-4d96-b5f1-86e5193a42da-device-dir\") pod \"aws-ebs-csi-driver-node-wvktt\" (UID: \"6065b3cf-3d6f-4d96-b5f1-86e5193a42da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.402235 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402162    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbz5t\" (UniqueName: \"kubernetes.io/projected/9486873e-4c69-4b47-b22b-7e820e7d2ce1-kube-api-access-hbz5t\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.402235 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402214    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-etc-openvswitch\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.402235 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402234    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9glq2\" (UniqueName: \"kubernetes.io/projected/1e265d02-f5f7-4c23-9d76-a93bcd720de2-kube-api-access-9glq2\") pod \"multus-additional-cni-plugins-hxnt8\" (UID: \"1e265d02-f5f7-4c23-9d76-a93bcd720de2\") " pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.402973 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402252    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-node-log\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.402973 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402286    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-host-cni-netd\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.402973 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402311    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53f7663e-7918-49a1-a518-841a4119398c-host-slash\") pod \"iptables-alerter-n4hgt\" (UID: \"53f7663e-7918-49a1-a518-841a4119398c\") " pod="openshift-network-operator/iptables-alerter-n4hgt"
Sep 10 15:15:49.402973 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402334    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-multus-socket-dir-parent\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.402973 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402357    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-host-var-lib-cni-bin\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.402973 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402372    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53f7663e-7918-49a1-a518-841a4119398c-host-slash\") pod \"iptables-alerter-n4hgt\" (UID: \"53f7663e-7918-49a1-a518-841a4119398c\") " pod="openshift-network-operator/iptables-alerter-n4hgt"
Sep 10 15:15:49.402973 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402378    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-multus-conf-dir\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.402973 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402394    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-systemd-units\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.402973 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402412    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4577fae-7022-4064-98d2-99edb6be056c-env-overrides\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.402973 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402439    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-etc-sysctl-d\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.402973 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402458    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1e265d02-f5f7-4c23-9d76-a93bcd720de2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hxnt8\" (UID: \"1e265d02-f5f7-4c23-9d76-a93bcd720de2\") " pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.402973 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402480    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-etc-sysconfig\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.402973 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402501    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-etc-kubernetes\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.402973 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402522    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lxxl\" (UniqueName: \"kubernetes.io/projected/a7ffe6a3-b6d6-4481-b023-95ad5eae05fc-kube-api-access-5lxxl\") pod \"node-ca-9ctw2\" (UID: \"a7ffe6a3-b6d6-4481-b023-95ad5eae05fc\") " pod="openshift-image-registry/node-ca-9ctw2"
Sep 10 15:15:49.402973 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402543    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-etc-sysconfig\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.402973 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402559    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret\") pod \"global-pull-secret-syncer-9qzxr\" (UID: \"8bd848e3-5919-4d0a-80c9-f2bd7f7db58b\") " pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:15:49.402973 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402583    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6065b3cf-3d6f-4d96-b5f1-86e5193a42da-etc-selinux\") pod \"aws-ebs-csi-driver-node-wvktt\" (UID: \"6065b3cf-3d6f-4d96-b5f1-86e5193a42da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.403748 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402595    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-etc-sysctl-d\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.403748 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402607    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-var-lib-openvswitch\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.403748 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402623    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-etc-kubernetes\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.403748 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402628    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4577fae-7022-4064-98d2-99edb6be056c-ovnkube-script-lib\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.403748 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402670    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3de18da0-a224-4960-998d-145e892f0916-etc-tuned\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.403748 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402699    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3de18da0-a224-4960-998d-145e892f0916-tmp\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.403748 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402734    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9486873e-4c69-4b47-b22b-7e820e7d2ce1-cni-binary-copy\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.403748 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402758    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-host-var-lib-cni-multus\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.403748 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402878    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-log-socket\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.403748 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402908    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.403748 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402949    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdmtp\" (UniqueName: \"kubernetes.io/projected/6065b3cf-3d6f-4d96-b5f1-86e5193a42da-kube-api-access-mdmtp\") pod \"aws-ebs-csi-driver-node-wvktt\" (UID: \"6065b3cf-3d6f-4d96-b5f1-86e5193a42da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.403748 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402974    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk77h\" (UniqueName: \"kubernetes.io/projected/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-kube-api-access-wk77h\") pod \"network-metrics-daemon-s87zw\" (UID: \"dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc\") " pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:15:49.403748 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.402999    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4ba47f2c-aa01-49e8-8b3a-2534c01624a4-hosts-file\") pod \"node-resolver-bj7vg\" (UID: \"4ba47f2c-aa01-49e8-8b3a-2534c01624a4\") " pod="openshift-dns/node-resolver-bj7vg"
Sep 10 15:15:49.403748 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403025    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ba47f2c-aa01-49e8-8b3a-2534c01624a4-tmp-dir\") pod \"node-resolver-bj7vg\" (UID: \"4ba47f2c-aa01-49e8-8b3a-2534c01624a4\") " pod="openshift-dns/node-resolver-bj7vg"
Sep 10 15:15:49.403748 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403054    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-host-kubelet\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.403748 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403084    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-run-systemd\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.403748 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403126    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-etc-modprobe-d\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.404494 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403192    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1e265d02-f5f7-4c23-9d76-a93bcd720de2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hxnt8\" (UID: \"1e265d02-f5f7-4c23-9d76-a93bcd720de2\") " pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.404494 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403242    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6065b3cf-3d6f-4d96-b5f1-86e5193a42da-registration-dir\") pod \"aws-ebs-csi-driver-node-wvktt\" (UID: \"6065b3cf-3d6f-4d96-b5f1-86e5193a42da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.404494 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403279    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4577fae-7022-4064-98d2-99edb6be056c-ovnkube-config\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.404494 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403312    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a965c17d-32ee-4814-8067-df4b73b8ea0a-agent-certs\") pod \"konnectivity-agent-tm2gm\" (UID: \"a965c17d-32ee-4814-8067-df4b73b8ea0a\") " pod="kube-system/konnectivity-agent-tm2gm"
Sep 10 15:15:49.404494 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403338    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-cnibin\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.404494 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403368    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-host-run-k8s-cni-cncf-io\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.404494 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403397    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-host-run-netns\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.404494 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403427    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-run-openvswitch\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.404494 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403432    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 15:15:49.404494 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403467    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkrd2\" (UniqueName: \"kubernetes.io/projected/e4577fae-7022-4064-98d2-99edb6be056c-kube-api-access-lkrd2\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.404494 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403495    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-var-lib-kubelet\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.404494 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403523    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st8tn\" (UniqueName: \"kubernetes.io/projected/3de18da0-a224-4960-998d-145e892f0916-kube-api-access-st8tn\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.404494 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403550    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-hostroot\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.404494 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403573    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4577fae-7022-4064-98d2-99edb6be056c-ovn-node-metrics-cert\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.404494 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403602    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/53f7663e-7918-49a1-a518-841a4119398c-iptables-alerter-script\") pod \"iptables-alerter-n4hgt\" (UID: \"53f7663e-7918-49a1-a518-841a4119398c\") " pod="openshift-network-operator/iptables-alerter-n4hgt"
Sep 10 15:15:49.404494 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403630    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-run\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.404494 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403658    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-lib-modules\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.405276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403683    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7ffe6a3-b6d6-4481-b023-95ad5eae05fc-host\") pod \"node-ca-9ctw2\" (UID: \"a7ffe6a3-b6d6-4481-b023-95ad5eae05fc\") " pod="openshift-image-registry/node-ca-9ctw2"
Sep 10 15:15:49.405276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403732    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-system-cni-dir\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.405276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403764    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-host-var-lib-kubelet\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.405276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403788    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a965c17d-32ee-4814-8067-df4b73b8ea0a-konnectivity-ca\") pod \"konnectivity-agent-tm2gm\" (UID: \"a965c17d-32ee-4814-8067-df4b73b8ea0a\") " pod="kube-system/konnectivity-agent-tm2gm"
Sep 10 15:15:49.405276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403812    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-sys\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.405276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403849    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e265d02-f5f7-4c23-9d76-a93bcd720de2-system-cni-dir\") pod \"multus-additional-cni-plugins-hxnt8\" (UID: \"1e265d02-f5f7-4c23-9d76-a93bcd720de2\") " pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.405276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403917    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-var-lib-kubelet\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.405276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.403919    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e265d02-f5f7-4c23-9d76-a93bcd720de2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hxnt8\" (UID: \"1e265d02-f5f7-4c23-9d76-a93bcd720de2\") " pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.405276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.404027    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-kubelet-config\") pod \"global-pull-secret-syncer-9qzxr\" (UID: \"8bd848e3-5919-4d0a-80c9-f2bd7f7db58b\") " pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:15:49.405276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.404328    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-lib-modules\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.405276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.404373    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-etc-modprobe-d\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.405276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.404859    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a965c17d-32ee-4814-8067-df4b73b8ea0a-konnectivity-ca\") pod \"konnectivity-agent-tm2gm\" (UID: \"a965c17d-32ee-4814-8067-df4b73b8ea0a\") " pod="kube-system/konnectivity-agent-tm2gm"
Sep 10 15:15:49.405276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.405011    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-sys\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.405276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.405072    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3de18da0-a224-4960-998d-145e892f0916-run\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.405276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.405174    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/53f7663e-7918-49a1-a518-841a4119398c-iptables-alerter-script\") pod \"iptables-alerter-n4hgt\" (UID: \"53f7663e-7918-49a1-a518-841a4119398c\") " pod="openshift-network-operator/iptables-alerter-n4hgt"
Sep 10 15:15:49.407623 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.407539    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3de18da0-a224-4960-998d-145e892f0916-tmp\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.407854 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.407832    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a965c17d-32ee-4814-8067-df4b73b8ea0a-agent-certs\") pod \"konnectivity-agent-tm2gm\" (UID: \"a965c17d-32ee-4814-8067-df4b73b8ea0a\") " pod="kube-system/konnectivity-agent-tm2gm"
Sep 10 15:15:49.408294 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.408272    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3de18da0-a224-4960-998d-145e892f0916-etc-tuned\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.410252 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.410206    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-37.ec2.internal" event={"ID":"4a9dcbb4f6971a42593aebbbeaf48432","Type":"ContainerStarted","Data":"21359c690651e055c5073912fb8a28558c80dcdeb2e798042ad3b3608e5391b4"}
Sep 10 15:15:49.411571 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:49.411285    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 15:15:49.411571 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:49.411309    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 15:15:49.411571 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:49.411338    2574 projected.go:196] Error preparing data for projected volume kube-api-access-qcgwn for pod openshift-network-diagnostics/network-check-target-jfhkb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:15:49.411571 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:49.411400    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn podName:17387da0-5265-4e58-9383-ccc3e8cbf5ea nodeName:}" failed. No retries permitted until 2026-09-10 15:15:49.91138072 +0000 UTC m=+2.961179220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qcgwn" (UniqueName: "kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn") pod "network-check-target-jfhkb" (UID: "17387da0-5265-4e58-9383-ccc3e8cbf5ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:15:49.412708 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.412664    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-37.ec2.internal" event={"ID":"7145b012af55e41dcb0c2a41a9ae7904","Type":"ContainerStarted","Data":"017a6f3beba5f61f7867b192713d097acd18415ef7a4b35a1ab9b4b561f7d63d"}
Sep 10 15:15:49.414091 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.414068    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96nsj\" (UniqueName: \"kubernetes.io/projected/53f7663e-7918-49a1-a518-841a4119398c-kube-api-access-96nsj\") pod \"iptables-alerter-n4hgt\" (UID: \"53f7663e-7918-49a1-a518-841a4119398c\") " pod="openshift-network-operator/iptables-alerter-n4hgt"
Sep 10 15:15:49.414473 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.414437    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st8tn\" (UniqueName: \"kubernetes.io/projected/3de18da0-a224-4960-998d-145e892f0916-kube-api-access-st8tn\") pod \"tuned-sm8v7\" (UID: \"3de18da0-a224-4960-998d-145e892f0916\") " pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.504605 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.504575    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-host-var-lib-cni-bin\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.504783 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.504618    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-multus-conf-dir\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.504783 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.504640    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-systemd-units\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.504783 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.504656    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4577fae-7022-4064-98d2-99edb6be056c-env-overrides\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.504783 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.504681    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1e265d02-f5f7-4c23-9d76-a93bcd720de2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hxnt8\" (UID: \"1e265d02-f5f7-4c23-9d76-a93bcd720de2\") " pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.504783 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.504692    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-multus-conf-dir\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.504783 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.504711    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lxxl\" (UniqueName: \"kubernetes.io/projected/a7ffe6a3-b6d6-4481-b023-95ad5eae05fc-kube-api-access-5lxxl\") pod \"node-ca-9ctw2\" (UID: \"a7ffe6a3-b6d6-4481-b023-95ad5eae05fc\") " pod="openshift-image-registry/node-ca-9ctw2"
Sep 10 15:15:49.504783 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.504648    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-host-var-lib-cni-bin\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.504783 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.504748    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret\") pod \"global-pull-secret-syncer-9qzxr\" (UID: \"8bd848e3-5919-4d0a-80c9-f2bd7f7db58b\") " pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:15:49.504783 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.504766    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-systemd-units\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.504783 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.504779    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6065b3cf-3d6f-4d96-b5f1-86e5193a42da-etc-selinux\") pod \"aws-ebs-csi-driver-node-wvktt\" (UID: \"6065b3cf-3d6f-4d96-b5f1-86e5193a42da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.505302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.504816    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-var-lib-openvswitch\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.505302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.504844    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4577fae-7022-4064-98d2-99edb6be056c-ovnkube-script-lib\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.505302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.504871    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9486873e-4c69-4b47-b22b-7e820e7d2ce1-cni-binary-copy\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.505302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.504884    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6065b3cf-3d6f-4d96-b5f1-86e5193a42da-etc-selinux\") pod \"aws-ebs-csi-driver-node-wvktt\" (UID: \"6065b3cf-3d6f-4d96-b5f1-86e5193a42da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.505302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.504896    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-host-var-lib-cni-multus\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.505302 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:49.504899    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 15:15:49.505302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.504920    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-log-socket\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.505302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.504964    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.505302 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:49.504993    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret podName:8bd848e3-5919-4d0a-80c9-f2bd7f7db58b nodeName:}" failed. No retries permitted until 2026-09-10 15:15:50.004973215 +0000 UTC m=+3.054771723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret") pod "global-pull-secret-syncer-9qzxr" (UID: "8bd848e3-5919-4d0a-80c9-f2bd7f7db58b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 15:15:49.505302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505006    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-log-socket\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.505302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505007    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-host-var-lib-cni-multus\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.505302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505036    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdmtp\" (UniqueName: \"kubernetes.io/projected/6065b3cf-3d6f-4d96-b5f1-86e5193a42da-kube-api-access-mdmtp\") pod \"aws-ebs-csi-driver-node-wvktt\" (UID: \"6065b3cf-3d6f-4d96-b5f1-86e5193a42da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.505302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505056    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.505302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505063    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk77h\" (UniqueName: \"kubernetes.io/projected/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-kube-api-access-wk77h\") pod \"network-metrics-daemon-s87zw\" (UID: \"dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc\") " pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:15:49.505302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505090    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4ba47f2c-aa01-49e8-8b3a-2534c01624a4-hosts-file\") pod \"node-resolver-bj7vg\" (UID: \"4ba47f2c-aa01-49e8-8b3a-2534c01624a4\") " pod="openshift-dns/node-resolver-bj7vg"
Sep 10 15:15:49.505302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505117    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ba47f2c-aa01-49e8-8b3a-2534c01624a4-tmp-dir\") pod \"node-resolver-bj7vg\" (UID: \"4ba47f2c-aa01-49e8-8b3a-2534c01624a4\") " pod="openshift-dns/node-resolver-bj7vg"
Sep 10 15:15:49.505302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505141    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-host-kubelet\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.506124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505148    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-var-lib-openvswitch\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.506124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505181    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-run-systemd\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.506124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505212    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1e265d02-f5f7-4c23-9d76-a93bcd720de2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hxnt8\" (UID: \"1e265d02-f5f7-4c23-9d76-a93bcd720de2\") " pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.506124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505231    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4577fae-7022-4064-98d2-99edb6be056c-env-overrides\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.506124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505244    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6065b3cf-3d6f-4d96-b5f1-86e5193a42da-registration-dir\") pod \"aws-ebs-csi-driver-node-wvktt\" (UID: \"6065b3cf-3d6f-4d96-b5f1-86e5193a42da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.506124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505269    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4577fae-7022-4064-98d2-99edb6be056c-ovnkube-config\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.506124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505293    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-cnibin\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.506124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505294    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-run-systemd\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.506124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505331    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-host-run-k8s-cni-cncf-io\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.506124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505361    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-host-run-netns\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.506124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505385    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-run-openvswitch\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.506124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505399    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4ba47f2c-aa01-49e8-8b3a-2534c01624a4-hosts-file\") pod \"node-resolver-bj7vg\" (UID: \"4ba47f2c-aa01-49e8-8b3a-2534c01624a4\") " pod="openshift-dns/node-resolver-bj7vg"
Sep 10 15:15:49.506124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505409    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkrd2\" (UniqueName: \"kubernetes.io/projected/e4577fae-7022-4064-98d2-99edb6be056c-kube-api-access-lkrd2\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.506124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505415    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ba47f2c-aa01-49e8-8b3a-2534c01624a4-tmp-dir\") pod \"node-resolver-bj7vg\" (UID: \"4ba47f2c-aa01-49e8-8b3a-2534c01624a4\") " pod="openshift-dns/node-resolver-bj7vg"
Sep 10 15:15:49.506124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505435    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-hostroot\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.506124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505444    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4577fae-7022-4064-98d2-99edb6be056c-ovnkube-script-lib\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.506124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505451    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6065b3cf-3d6f-4d96-b5f1-86e5193a42da-registration-dir\") pod \"aws-ebs-csi-driver-node-wvktt\" (UID: \"6065b3cf-3d6f-4d96-b5f1-86e5193a42da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.506902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505459    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4577fae-7022-4064-98d2-99edb6be056c-ovn-node-metrics-cert\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.506902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505470    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-host-run-k8s-cni-cncf-io\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.506902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505486    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7ffe6a3-b6d6-4481-b023-95ad5eae05fc-host\") pod \"node-ca-9ctw2\" (UID: \"a7ffe6a3-b6d6-4481-b023-95ad5eae05fc\") " pod="openshift-image-registry/node-ca-9ctw2"
Sep 10 15:15:49.506902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505495    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-host-kubelet\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.506902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505493    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-run-openvswitch\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.506902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505512    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-system-cni-dir\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.506902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505522    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-cnibin\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.506902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505537    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-hostroot\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.506902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505536    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-host-var-lib-kubelet\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.506902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505575    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-host-run-netns\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.506902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505576    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e265d02-f5f7-4c23-9d76-a93bcd720de2-system-cni-dir\") pod \"multus-additional-cni-plugins-hxnt8\" (UID: \"1e265d02-f5f7-4c23-9d76-a93bcd720de2\") " pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.506902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505604    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e265d02-f5f7-4c23-9d76-a93bcd720de2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hxnt8\" (UID: \"1e265d02-f5f7-4c23-9d76-a93bcd720de2\") " pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.506902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505629    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-kubelet-config\") pod \"global-pull-secret-syncer-9qzxr\" (UID: \"8bd848e3-5919-4d0a-80c9-f2bd7f7db58b\") " pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:15:49.506902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505640    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e265d02-f5f7-4c23-9d76-a93bcd720de2-system-cni-dir\") pod \"multus-additional-cni-plugins-hxnt8\" (UID: \"1e265d02-f5f7-4c23-9d76-a93bcd720de2\") " pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.506902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505653    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-multus-cni-dir\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.506902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505677    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-host-run-multus-certs\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.506902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505719    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-host-slash\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.506902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505721    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-kubelet-config\") pod \"global-pull-secret-syncer-9qzxr\" (UID: \"8bd848e3-5919-4d0a-80c9-f2bd7f7db58b\") " pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:15:49.507810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505746    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6065b3cf-3d6f-4d96-b5f1-86e5193a42da-sys-fs\") pod \"aws-ebs-csi-driver-node-wvktt\" (UID: \"6065b3cf-3d6f-4d96-b5f1-86e5193a42da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.507810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505770    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-host-run-netns\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.507810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505772    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-host-var-lib-kubelet\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.507810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505802    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-host-run-netns\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.507810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505819    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-system-cni-dir\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.507810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505820    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-host-run-multus-certs\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.507810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505847    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-run-ovn\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.507810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505849    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7ffe6a3-b6d6-4481-b023-95ad5eae05fc-host\") pod \"node-ca-9ctw2\" (UID: \"a7ffe6a3-b6d6-4481-b023-95ad5eae05fc\") " pod="openshift-image-registry/node-ca-9ctw2"
Sep 10 15:15:49.507810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505884    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6065b3cf-3d6f-4d96-b5f1-86e5193a42da-sys-fs\") pod \"aws-ebs-csi-driver-node-wvktt\" (UID: \"6065b3cf-3d6f-4d96-b5f1-86e5193a42da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.507810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505914    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-run-ovn\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.507810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505919    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-host-slash\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.507810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505951    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7ffe6a3-b6d6-4481-b023-95ad5eae05fc-serviceca\") pod \"node-ca-9ctw2\" (UID: \"a7ffe6a3-b6d6-4481-b023-95ad5eae05fc\") " pod="openshift-image-registry/node-ca-9ctw2"
Sep 10 15:15:49.507810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505989    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-etc-kubernetes\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.507810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505999    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e265d02-f5f7-4c23-9d76-a93bcd720de2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hxnt8\" (UID: \"1e265d02-f5f7-4c23-9d76-a93bcd720de2\") " pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.507810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505923    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-multus-cni-dir\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.507810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506020    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-host-run-ovn-kubernetes\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.507810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506047    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-host-cni-bin\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.507810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506075    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-host-run-ovn-kubernetes\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.508592 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506075    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e265d02-f5f7-4c23-9d76-a93bcd720de2-cni-binary-copy\") pod \"multus-additional-cni-plugins-hxnt8\" (UID: \"1e265d02-f5f7-4c23-9d76-a93bcd720de2\") " pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.508592 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506090    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4577fae-7022-4064-98d2-99edb6be056c-ovnkube-config\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.508592 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506107    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-dbus\") pod \"global-pull-secret-syncer-9qzxr\" (UID: \"8bd848e3-5919-4d0a-80c9-f2bd7f7db58b\") " pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:15:49.508592 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506050    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-etc-kubernetes\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.508592 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506130    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6065b3cf-3d6f-4d96-b5f1-86e5193a42da-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wvktt\" (UID: \"6065b3cf-3d6f-4d96-b5f1-86e5193a42da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.508592 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506134    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-host-cni-bin\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.508592 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506156    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9486873e-4c69-4b47-b22b-7e820e7d2ce1-multus-daemon-config\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.508592 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506167    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-dbus\") pod \"global-pull-secret-syncer-9qzxr\" (UID: \"8bd848e3-5919-4d0a-80c9-f2bd7f7db58b\") " pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:15:49.508592 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506186    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs\") pod \"network-metrics-daemon-s87zw\" (UID: \"dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc\") " pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:15:49.508592 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506191    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6065b3cf-3d6f-4d96-b5f1-86e5193a42da-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wvktt\" (UID: \"6065b3cf-3d6f-4d96-b5f1-86e5193a42da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.508592 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506213    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h54f6\" (UniqueName: \"kubernetes.io/projected/4ba47f2c-aa01-49e8-8b3a-2534c01624a4-kube-api-access-h54f6\") pod \"node-resolver-bj7vg\" (UID: \"4ba47f2c-aa01-49e8-8b3a-2534c01624a4\") " pod="openshift-dns/node-resolver-bj7vg"
Sep 10 15:15:49.508592 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506239    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e265d02-f5f7-4c23-9d76-a93bcd720de2-cnibin\") pod \"multus-additional-cni-plugins-hxnt8\" (UID: \"1e265d02-f5f7-4c23-9d76-a93bcd720de2\") " pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.508592 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506265    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6065b3cf-3d6f-4d96-b5f1-86e5193a42da-socket-dir\") pod \"aws-ebs-csi-driver-node-wvktt\" (UID: \"6065b3cf-3d6f-4d96-b5f1-86e5193a42da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.508592 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:49.506283    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:15:49.508592 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506289    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6065b3cf-3d6f-4d96-b5f1-86e5193a42da-device-dir\") pod \"aws-ebs-csi-driver-node-wvktt\" (UID: \"6065b3cf-3d6f-4d96-b5f1-86e5193a42da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.508592 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506314    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbz5t\" (UniqueName: \"kubernetes.io/projected/9486873e-4c69-4b47-b22b-7e820e7d2ce1-kube-api-access-hbz5t\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.508592 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506342    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-etc-openvswitch\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.508592 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506368    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9glq2\" (UniqueName: \"kubernetes.io/projected/1e265d02-f5f7-4c23-9d76-a93bcd720de2-kube-api-access-9glq2\") pod \"multus-additional-cni-plugins-hxnt8\" (UID: \"1e265d02-f5f7-4c23-9d76-a93bcd720de2\") " pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.509214 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506393    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-node-log\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.509214 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506411    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-etc-openvswitch\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.509214 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506415    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-host-cni-netd\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.509214 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506440    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6065b3cf-3d6f-4d96-b5f1-86e5193a42da-socket-dir\") pod \"aws-ebs-csi-driver-node-wvktt\" (UID: \"6065b3cf-3d6f-4d96-b5f1-86e5193a42da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.509214 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506449    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-host-cni-netd\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.509214 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506459    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-multus-socket-dir-parent\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.509214 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:49.506484    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs podName:dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc nodeName:}" failed. No retries permitted until 2026-09-10 15:15:50.006466048 +0000 UTC m=+3.056264541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs") pod "network-metrics-daemon-s87zw" (UID: "dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:15:49.509214 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506370    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7ffe6a3-b6d6-4481-b023-95ad5eae05fc-serviceca\") pod \"node-ca-9ctw2\" (UID: \"a7ffe6a3-b6d6-4481-b023-95ad5eae05fc\") " pod="openshift-image-registry/node-ca-9ctw2"
Sep 10 15:15:49.509214 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506517    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1e265d02-f5f7-4c23-9d76-a93bcd720de2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hxnt8\" (UID: \"1e265d02-f5f7-4c23-9d76-a93bcd720de2\") " pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.509214 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506539    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9486873e-4c69-4b47-b22b-7e820e7d2ce1-multus-socket-dir-parent\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.509214 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506591    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6065b3cf-3d6f-4d96-b5f1-86e5193a42da-device-dir\") pod \"aws-ebs-csi-driver-node-wvktt\" (UID: \"6065b3cf-3d6f-4d96-b5f1-86e5193a42da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.509214 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506595    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9486873e-4c69-4b47-b22b-7e820e7d2ce1-multus-daemon-config\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.509214 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506638    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4577fae-7022-4064-98d2-99edb6be056c-node-log\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.509214 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506644    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e265d02-f5f7-4c23-9d76-a93bcd720de2-cnibin\") pod \"multus-additional-cni-plugins-hxnt8\" (UID: \"1e265d02-f5f7-4c23-9d76-a93bcd720de2\") " pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.509214 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.505562    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9486873e-4c69-4b47-b22b-7e820e7d2ce1-cni-binary-copy\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.509214 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506921    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e265d02-f5f7-4c23-9d76-a93bcd720de2-cni-binary-copy\") pod \"multus-additional-cni-plugins-hxnt8\" (UID: \"1e265d02-f5f7-4c23-9d76-a93bcd720de2\") " pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.509214 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.506921    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1e265d02-f5f7-4c23-9d76-a93bcd720de2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hxnt8\" (UID: \"1e265d02-f5f7-4c23-9d76-a93bcd720de2\") " pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.509775 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.508631    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4577fae-7022-4064-98d2-99edb6be056c-ovn-node-metrics-cert\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.518859 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.518835    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lxxl\" (UniqueName: \"kubernetes.io/projected/a7ffe6a3-b6d6-4481-b023-95ad5eae05fc-kube-api-access-5lxxl\") pod \"node-ca-9ctw2\" (UID: \"a7ffe6a3-b6d6-4481-b023-95ad5eae05fc\") " pod="openshift-image-registry/node-ca-9ctw2"
Sep 10 15:15:49.526142 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.526090    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h54f6\" (UniqueName: \"kubernetes.io/projected/4ba47f2c-aa01-49e8-8b3a-2534c01624a4-kube-api-access-h54f6\") pod \"node-resolver-bj7vg\" (UID: \"4ba47f2c-aa01-49e8-8b3a-2534c01624a4\") " pod="openshift-dns/node-resolver-bj7vg"
Sep 10 15:15:49.526757 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.526728    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbz5t\" (UniqueName: \"kubernetes.io/projected/9486873e-4c69-4b47-b22b-7e820e7d2ce1-kube-api-access-hbz5t\") pod \"multus-c2rmh\" (UID: \"9486873e-4c69-4b47-b22b-7e820e7d2ce1\") " pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.526852 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.526767    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdmtp\" (UniqueName: \"kubernetes.io/projected/6065b3cf-3d6f-4d96-b5f1-86e5193a42da-kube-api-access-mdmtp\") pod \"aws-ebs-csi-driver-node-wvktt\" (UID: \"6065b3cf-3d6f-4d96-b5f1-86e5193a42da\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:49.527083 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.527064    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk77h\" (UniqueName: \"kubernetes.io/projected/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-kube-api-access-wk77h\") pod \"network-metrics-daemon-s87zw\" (UID: \"dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc\") " pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:15:49.527646 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.527619    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9glq2\" (UniqueName: \"kubernetes.io/projected/1e265d02-f5f7-4c23-9d76-a93bcd720de2-kube-api-access-9glq2\") pod \"multus-additional-cni-plugins-hxnt8\" (UID: \"1e265d02-f5f7-4c23-9d76-a93bcd720de2\") " pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.528210 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.528182    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkrd2\" (UniqueName: \"kubernetes.io/projected/e4577fae-7022-4064-98d2-99edb6be056c-kube-api-access-lkrd2\") pod \"ovnkube-node-cd4sl\" (UID: \"e4577fae-7022-4064-98d2-99edb6be056c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.598732 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.598704    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tm2gm"
Sep 10 15:15:49.609282 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.609208    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n4hgt"
Sep 10 15:15:49.619914 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.619890    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sm8v7"
Sep 10 15:15:49.625589 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.625566    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bj7vg"
Sep 10 15:15:49.632222 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.632198    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9ctw2"
Sep 10 15:15:49.640796 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.640775    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c2rmh"
Sep 10 15:15:49.648450 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.648434    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hxnt8"
Sep 10 15:15:49.656056 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.656039    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:15:49.661741 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:49.661722    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt"
Sep 10 15:15:50.009636 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:50.009549    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs\") pod \"network-metrics-daemon-s87zw\" (UID: \"dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc\") " pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:15:50.009636 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:50.009621    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret\") pod \"global-pull-secret-syncer-9qzxr\" (UID: \"8bd848e3-5919-4d0a-80c9-f2bd7f7db58b\") " pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:15:50.009839 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:50.009683    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcgwn\" (UniqueName: \"kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn\") pod \"network-check-target-jfhkb\" (UID: \"17387da0-5265-4e58-9383-ccc3e8cbf5ea\") " pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:15:50.009839 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:50.009700    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:15:50.009839 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:50.009763    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs podName:dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc nodeName:}" failed. No retries permitted until 2026-09-10 15:15:51.009741809 +0000 UTC m=+4.059540313 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs") pod "network-metrics-daemon-s87zw" (UID: "dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:15:50.009839 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:50.009782    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 15:15:50.009839 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:50.009786    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 15:15:50.009839 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:50.009797    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 15:15:50.009839 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:50.009808    2574 projected.go:196] Error preparing data for projected volume kube-api-access-qcgwn for pod openshift-network-diagnostics/network-check-target-jfhkb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:15:50.009839 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:50.009835    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret podName:8bd848e3-5919-4d0a-80c9-f2bd7f7db58b nodeName:}" failed. No retries permitted until 2026-09-10 15:15:51.009820796 +0000 UTC m=+4.059619286 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret") pod "global-pull-secret-syncer-9qzxr" (UID: "8bd848e3-5919-4d0a-80c9-f2bd7f7db58b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 15:15:50.010172 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:50.009848    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn podName:17387da0-5265-4e58-9383-ccc3e8cbf5ea nodeName:}" failed. No retries permitted until 2026-09-10 15:15:51.009842854 +0000 UTC m=+4.059641343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qcgwn" (UniqueName: "kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn") pod "network-check-target-jfhkb" (UID: "17387da0-5265-4e58-9383-ccc3e8cbf5ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:15:50.338648 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:50.338579    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 15:10:49 +0000 UTC" deadline="2028-04-16 03:54:51.89464839 +0000 UTC"
Sep 10 15:15:50.338648 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:50.338607    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14004h39m1.556044104s"
Sep 10 15:15:50.397623 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:50.397380    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de18da0_a224_4960_998d_145e892f0916.slice/crio-2b313ccacb4c3dfe22dd72c9f82980e33ff208a13d992edd7830dcfc3523491e WatchSource:0}: Error finding container 2b313ccacb4c3dfe22dd72c9f82980e33ff208a13d992edd7830dcfc3523491e: Status 404 returned error can't find the container with id 2b313ccacb4c3dfe22dd72c9f82980e33ff208a13d992edd7830dcfc3523491e
Sep 10 15:15:50.399469 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:50.399434    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9486873e_4c69_4b47_b22b_7e820e7d2ce1.slice/crio-0eddb8ff539374968d1e64718c321dfc320011f07f9f3ce106896cbaa25d1fd5 WatchSource:0}: Error finding container 0eddb8ff539374968d1e64718c321dfc320011f07f9f3ce106896cbaa25d1fd5: Status 404 returned error can't find the container with id 0eddb8ff539374968d1e64718c321dfc320011f07f9f3ce106896cbaa25d1fd5
Sep 10 15:15:50.400518 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:50.400486    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7ffe6a3_b6d6_4481_b023_95ad5eae05fc.slice/crio-f51cbcc9eb004b8a16764d0286791ee76cf8859c53a8cb91d86b31093b4b6b22 WatchSource:0}: Error finding container f51cbcc9eb004b8a16764d0286791ee76cf8859c53a8cb91d86b31093b4b6b22: Status 404 returned error can't find the container with id f51cbcc9eb004b8a16764d0286791ee76cf8859c53a8cb91d86b31093b4b6b22
Sep 10 15:15:50.402298 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:50.402271    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6065b3cf_3d6f_4d96_b5f1_86e5193a42da.slice/crio-0f9240e6b9f866e51d1726ab789e7e9808d5abdce3a84c55c901d96b4791ada1 WatchSource:0}: Error finding container 0f9240e6b9f866e51d1726ab789e7e9808d5abdce3a84c55c901d96b4791ada1: Status 404 returned error can't find the container with id 0f9240e6b9f866e51d1726ab789e7e9808d5abdce3a84c55c901d96b4791ada1
Sep 10 15:15:50.403391 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:50.403341    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba47f2c_aa01_49e8_8b3a_2534c01624a4.slice/crio-79138bb344f69ca18490115361a7633167e9179bcb95948aed8c9e47bf814afa WatchSource:0}: Error finding container 79138bb344f69ca18490115361a7633167e9179bcb95948aed8c9e47bf814afa: Status 404 returned error can't find the container with id 79138bb344f69ca18490115361a7633167e9179bcb95948aed8c9e47bf814afa
Sep 10 15:15:50.404052 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:50.404033    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4577fae_7022_4064_98d2_99edb6be056c.slice/crio-24c33cfe633f53ed01a3a45fcfbc32e815444f42a8bf18062f431c020b1c3f50 WatchSource:0}: Error finding container 24c33cfe633f53ed01a3a45fcfbc32e815444f42a8bf18062f431c020b1c3f50: Status 404 returned error can't find the container with id 24c33cfe633f53ed01a3a45fcfbc32e815444f42a8bf18062f431c020b1c3f50
Sep 10 15:15:50.406737 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:50.406661    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e265d02_f5f7_4c23_9d76_a93bcd720de2.slice/crio-459167eff1c68f366e0f594e874d794f633076ab23af0386c3487f11896a961f WatchSource:0}: Error finding container 459167eff1c68f366e0f594e874d794f633076ab23af0386c3487f11896a961f: Status 404 returned error can't find the container with id 459167eff1c68f366e0f594e874d794f633076ab23af0386c3487f11896a961f
Sep 10 15:15:50.408450 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:15:50.407176    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda965c17d_32ee_4814_8067_df4b73b8ea0a.slice/crio-7a07dd5591af4118c22783998427e02005cfd9654479af5519073fdecec555ca WatchSource:0}: Error finding container 7a07dd5591af4118c22783998427e02005cfd9654479af5519073fdecec555ca: Status 404 returned error can't find the container with id 7a07dd5591af4118c22783998427e02005cfd9654479af5519073fdecec555ca
Sep 10 15:15:50.416197 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:50.416172    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sm8v7" event={"ID":"3de18da0-a224-4960-998d-145e892f0916","Type":"ContainerStarted","Data":"2b313ccacb4c3dfe22dd72c9f82980e33ff208a13d992edd7830dcfc3523491e"}
Sep 10 15:15:50.417505 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:50.417481    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl" event={"ID":"e4577fae-7022-4064-98d2-99edb6be056c","Type":"ContainerStarted","Data":"24c33cfe633f53ed01a3a45fcfbc32e815444f42a8bf18062f431c020b1c3f50"}
Sep 10 15:15:50.418725 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:50.418702    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bj7vg" event={"ID":"4ba47f2c-aa01-49e8-8b3a-2534c01624a4","Type":"ContainerStarted","Data":"79138bb344f69ca18490115361a7633167e9179bcb95948aed8c9e47bf814afa"}
Sep 10 15:15:50.420033 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:50.420008    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt" event={"ID":"6065b3cf-3d6f-4d96-b5f1-86e5193a42da","Type":"ContainerStarted","Data":"0f9240e6b9f866e51d1726ab789e7e9808d5abdce3a84c55c901d96b4791ada1"}
Sep 10 15:15:50.421137 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:50.421113    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n4hgt" event={"ID":"53f7663e-7918-49a1-a518-841a4119398c","Type":"ContainerStarted","Data":"d60c41e2bf37b5c973492f25de0d8022bc2f877c9dd9ab9da2363e42579e165c"}
Sep 10 15:15:50.422376 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:50.422351    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tm2gm" event={"ID":"a965c17d-32ee-4814-8067-df4b73b8ea0a","Type":"ContainerStarted","Data":"7a07dd5591af4118c22783998427e02005cfd9654479af5519073fdecec555ca"}
Sep 10 15:15:50.423890 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:50.423868    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxnt8" event={"ID":"1e265d02-f5f7-4c23-9d76-a93bcd720de2","Type":"ContainerStarted","Data":"459167eff1c68f366e0f594e874d794f633076ab23af0386c3487f11896a961f"}
Sep 10 15:15:50.425136 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:50.425106    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9ctw2" event={"ID":"a7ffe6a3-b6d6-4481-b023-95ad5eae05fc","Type":"ContainerStarted","Data":"f51cbcc9eb004b8a16764d0286791ee76cf8859c53a8cb91d86b31093b4b6b22"}
Sep 10 15:15:50.426223 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:50.426197    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c2rmh" event={"ID":"9486873e-4c69-4b47-b22b-7e820e7d2ce1","Type":"ContainerStarted","Data":"0eddb8ff539374968d1e64718c321dfc320011f07f9f3ce106896cbaa25d1fd5"}
Sep 10 15:15:51.016979 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:51.016881    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcgwn\" (UniqueName: \"kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn\") pod \"network-check-target-jfhkb\" (UID: \"17387da0-5265-4e58-9383-ccc3e8cbf5ea\") " pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:15:51.017143 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:51.017019    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs\") pod \"network-metrics-daemon-s87zw\" (UID: \"dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc\") " pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:15:51.017143 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:51.017084    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret\") pod \"global-pull-secret-syncer-9qzxr\" (UID: \"8bd848e3-5919-4d0a-80c9-f2bd7f7db58b\") " pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:15:51.017255 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:51.017221    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 15:15:51.017306 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:51.017286    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret podName:8bd848e3-5919-4d0a-80c9-f2bd7f7db58b nodeName:}" failed. No retries permitted until 2026-09-10 15:15:53.017266243 +0000 UTC m=+6.067064752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret") pod "global-pull-secret-syncer-9qzxr" (UID: "8bd848e3-5919-4d0a-80c9-f2bd7f7db58b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 15:15:51.017735 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:51.017710    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 15:15:51.017803 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:51.017742    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 15:15:51.017803 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:51.017755    2574 projected.go:196] Error preparing data for projected volume kube-api-access-qcgwn for pod openshift-network-diagnostics/network-check-target-jfhkb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:15:51.017908 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:51.017807    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn podName:17387da0-5265-4e58-9383-ccc3e8cbf5ea nodeName:}" failed. No retries permitted until 2026-09-10 15:15:53.017790754 +0000 UTC m=+6.067589245 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qcgwn" (UniqueName: "kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn") pod "network-check-target-jfhkb" (UID: "17387da0-5265-4e58-9383-ccc3e8cbf5ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:15:51.017908 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:51.017871    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:15:51.017908 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:51.017906    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs podName:dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc nodeName:}" failed. No retries permitted until 2026-09-10 15:15:53.01789421 +0000 UTC m=+6.067692715 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs") pod "network-metrics-daemon-s87zw" (UID: "dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:15:51.338873 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:51.338763    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 15:10:49 +0000 UTC" deadline="2028-02-16 21:35:01.496705287 +0000 UTC"
Sep 10 15:15:51.338873 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:51.338824    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12582h19m10.157885164s"
Sep 10 15:15:51.405574 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:51.405082    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:15:51.405574 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:51.405082    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:15:51.405574 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:51.405212    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhkb" podUID="17387da0-5265-4e58-9383-ccc3e8cbf5ea"
Sep 10 15:15:51.405574 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:51.405355    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s87zw" podUID="dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc"
Sep 10 15:15:51.405574 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:51.405372    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:15:51.405574 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:51.405517    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qzxr" podUID="8bd848e3-5919-4d0a-80c9-f2bd7f7db58b"
Sep 10 15:15:51.441807 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:51.441412    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-37.ec2.internal" event={"ID":"7145b012af55e41dcb0c2a41a9ae7904","Type":"ContainerStarted","Data":"fd952c3eee60a0019575958431e79444bbfce5cea3fd61e7d47924a77505aeda"}
Sep 10 15:15:51.458617 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:51.458563    2574 generic.go:356] "Generic (PLEG): container finished" podID="4a9dcbb4f6971a42593aebbbeaf48432" containerID="4011ec810e4f903936a25abb9a65208cb377cafe900fbf6c77c05ef4cf8d63c8" exitCode=0
Sep 10 15:15:51.458617 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:51.458607    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-37.ec2.internal" event={"ID":"4a9dcbb4f6971a42593aebbbeaf48432","Type":"ContainerDied","Data":"4011ec810e4f903936a25abb9a65208cb377cafe900fbf6c77c05ef4cf8d63c8"}
Sep 10 15:15:51.498097 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:51.498030    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-37.ec2.internal" podStartSLOduration=3.498008554 podStartE2EDuration="3.498008554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:15:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:15:51.463224212 +0000 UTC m=+4.513022722" watchObservedRunningTime="2026-09-10 15:15:51.498008554 +0000 UTC m=+4.547807061"
Sep 10 15:15:52.478160 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:52.477981    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-37.ec2.internal" event={"ID":"4a9dcbb4f6971a42593aebbbeaf48432","Type":"ContainerStarted","Data":"203fab5f5c9fedc0181f0a78ddac7f8c9293badaedd3d9cf1e2150b3f9a34206"}
Sep 10 15:15:53.033888 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:53.032848    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret\") pod \"global-pull-secret-syncer-9qzxr\" (UID: \"8bd848e3-5919-4d0a-80c9-f2bd7f7db58b\") " pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:15:53.033888 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:53.032953    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcgwn\" (UniqueName: \"kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn\") pod \"network-check-target-jfhkb\" (UID: \"17387da0-5265-4e58-9383-ccc3e8cbf5ea\") " pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:15:53.033888 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:53.032989    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs\") pod \"network-metrics-daemon-s87zw\" (UID: \"dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc\") " pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:15:53.033888 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:53.033117    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:15:53.033888 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:53.033184    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs podName:dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc nodeName:}" failed. No retries permitted until 2026-09-10 15:15:57.03316327 +0000 UTC m=+10.082961770 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs") pod "network-metrics-daemon-s87zw" (UID: "dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:15:53.033888 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:53.033654    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 15:15:53.033888 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:53.033705    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret podName:8bd848e3-5919-4d0a-80c9-f2bd7f7db58b nodeName:}" failed. No retries permitted until 2026-09-10 15:15:57.033689921 +0000 UTC m=+10.083488412 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret") pod "global-pull-secret-syncer-9qzxr" (UID: "8bd848e3-5919-4d0a-80c9-f2bd7f7db58b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 15:15:53.033888 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:53.033784    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 15:15:53.033888 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:53.033802    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 15:15:53.033888 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:53.033815    2574 projected.go:196] Error preparing data for projected volume kube-api-access-qcgwn for pod openshift-network-diagnostics/network-check-target-jfhkb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:15:53.033888 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:53.033852    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn podName:17387da0-5265-4e58-9383-ccc3e8cbf5ea nodeName:}" failed. No retries permitted until 2026-09-10 15:15:57.033841095 +0000 UTC m=+10.083639597 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qcgwn" (UniqueName: "kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn") pod "network-check-target-jfhkb" (UID: "17387da0-5265-4e58-9383-ccc3e8cbf5ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:15:53.407131 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:53.406110    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:15:53.407131 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:53.406299    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhkb" podUID="17387da0-5265-4e58-9383-ccc3e8cbf5ea"
Sep 10 15:15:53.407131 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:53.406694    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:15:53.407131 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:53.406783    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qzxr" podUID="8bd848e3-5919-4d0a-80c9-f2bd7f7db58b"
Sep 10 15:15:53.407131 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:53.406834    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:15:53.407131 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:53.407003    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s87zw" podUID="dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc"
Sep 10 15:15:55.404242 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:55.403734    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:15:55.404242 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:55.403734    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:15:55.404242 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:55.403887    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s87zw" podUID="dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc"
Sep 10 15:15:55.404242 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:55.403977    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhkb" podUID="17387da0-5265-4e58-9383-ccc3e8cbf5ea"
Sep 10 15:15:55.404242 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:55.404020    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:15:55.404242 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:55.404103    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qzxr" podUID="8bd848e3-5919-4d0a-80c9-f2bd7f7db58b"
Sep 10 15:15:57.067593 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:57.066972    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcgwn\" (UniqueName: \"kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn\") pod \"network-check-target-jfhkb\" (UID: \"17387da0-5265-4e58-9383-ccc3e8cbf5ea\") " pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:15:57.067593 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:57.067031    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs\") pod \"network-metrics-daemon-s87zw\" (UID: \"dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc\") " pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:15:57.067593 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:57.067072    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret\") pod \"global-pull-secret-syncer-9qzxr\" (UID: \"8bd848e3-5919-4d0a-80c9-f2bd7f7db58b\") " pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:15:57.067593 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:57.067207    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 15:15:57.067593 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:57.067271    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret podName:8bd848e3-5919-4d0a-80c9-f2bd7f7db58b nodeName:}" failed. No retries permitted until 2026-09-10 15:16:05.067251536 +0000 UTC m=+18.117050036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret") pod "global-pull-secret-syncer-9qzxr" (UID: "8bd848e3-5919-4d0a-80c9-f2bd7f7db58b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 15:15:57.067593 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:57.067490    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 15:15:57.067593 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:57.067521    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 15:15:57.067593 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:57.067527    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:15:57.067593 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:57.067535    2574 projected.go:196] Error preparing data for projected volume kube-api-access-qcgwn for pod openshift-network-diagnostics/network-check-target-jfhkb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:15:57.067593 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:57.067587    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs podName:dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc nodeName:}" failed. No retries permitted until 2026-09-10 15:16:05.067566778 +0000 UTC m=+18.117365279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs") pod "network-metrics-daemon-s87zw" (UID: "dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:15:57.067593 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:57.067608    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn podName:17387da0-5265-4e58-9383-ccc3e8cbf5ea nodeName:}" failed. No retries permitted until 2026-09-10 15:16:05.067598329 +0000 UTC m=+18.117396830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qcgwn" (UniqueName: "kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn") pod "network-check-target-jfhkb" (UID: "17387da0-5265-4e58-9383-ccc3e8cbf5ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:15:57.403915 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:57.403823    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:15:57.403915 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:57.403869    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:15:57.404215 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:57.404002    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhkb" podUID="17387da0-5265-4e58-9383-ccc3e8cbf5ea"
Sep 10 15:15:57.404215 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:57.404065    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qzxr" podUID="8bd848e3-5919-4d0a-80c9-f2bd7f7db58b"
Sep 10 15:15:57.404215 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:57.404102    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:15:57.404387 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:57.404217    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s87zw" podUID="dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc"
Sep 10 15:15:59.403264 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:59.403230    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:15:59.403264 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:59.403263    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:15:59.403719 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:15:59.403230    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:15:59.403719 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:59.403360    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhkb" podUID="17387da0-5265-4e58-9383-ccc3e8cbf5ea"
Sep 10 15:15:59.403719 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:59.403448    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s87zw" podUID="dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc"
Sep 10 15:15:59.403719 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:15:59.403516    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qzxr" podUID="8bd848e3-5919-4d0a-80c9-f2bd7f7db58b"
Sep 10 15:16:01.403285 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:01.403250    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:16:01.403737 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:01.403251    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:16:01.403737 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:01.403386    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qzxr" podUID="8bd848e3-5919-4d0a-80c9-f2bd7f7db58b"
Sep 10 15:16:01.403737 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:01.403475    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s87zw" podUID="dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc"
Sep 10 15:16:01.403737 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:01.403251    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:16:01.403737 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:01.403561    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhkb" podUID="17387da0-5265-4e58-9383-ccc3e8cbf5ea"
Sep 10 15:16:03.403115 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:03.403080    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:16:03.403526 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:03.403080    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:16:03.403526 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:03.403221    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qzxr" podUID="8bd848e3-5919-4d0a-80c9-f2bd7f7db58b"
Sep 10 15:16:03.403526 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:03.403271    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhkb" podUID="17387da0-5265-4e58-9383-ccc3e8cbf5ea"
Sep 10 15:16:03.403526 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:03.403099    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:16:03.403526 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:03.403342    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s87zw" podUID="dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc"
Sep 10 15:16:05.127022 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:05.126980    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcgwn\" (UniqueName: \"kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn\") pod \"network-check-target-jfhkb\" (UID: \"17387da0-5265-4e58-9383-ccc3e8cbf5ea\") " pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:16:05.127496 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:05.127044    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs\") pod \"network-metrics-daemon-s87zw\" (UID: \"dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc\") " pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:16:05.127496 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:05.127074    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret\") pod \"global-pull-secret-syncer-9qzxr\" (UID: \"8bd848e3-5919-4d0a-80c9-f2bd7f7db58b\") " pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:16:05.127496 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:05.127154    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:16:05.127496 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:05.127167    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 15:16:05.127496 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:05.127151    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 15:16:05.127496 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:05.127223    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs podName:dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc nodeName:}" failed. No retries permitted until 2026-09-10 15:16:21.12720681 +0000 UTC m=+34.177005296 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs") pod "network-metrics-daemon-s87zw" (UID: "dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:16:05.127496 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:05.127229    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 15:16:05.127496 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:05.127241    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret podName:8bd848e3-5919-4d0a-80c9-f2bd7f7db58b nodeName:}" failed. No retries permitted until 2026-09-10 15:16:21.127231817 +0000 UTC m=+34.177030303 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret") pod "global-pull-secret-syncer-9qzxr" (UID: "8bd848e3-5919-4d0a-80c9-f2bd7f7db58b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 15:16:05.127496 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:05.127244    2574 projected.go:196] Error preparing data for projected volume kube-api-access-qcgwn for pod openshift-network-diagnostics/network-check-target-jfhkb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:16:05.127496 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:05.127282    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn podName:17387da0-5265-4e58-9383-ccc3e8cbf5ea nodeName:}" failed. No retries permitted until 2026-09-10 15:16:21.127264504 +0000 UTC m=+34.177063019 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qcgwn" (UniqueName: "kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn") pod "network-check-target-jfhkb" (UID: "17387da0-5265-4e58-9383-ccc3e8cbf5ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:16:05.403495 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:05.403421    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:16:05.403651 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:05.403421    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:16:05.403651 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:05.403523    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhkb" podUID="17387da0-5265-4e58-9383-ccc3e8cbf5ea"
Sep 10 15:16:05.403651 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:05.403617    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s87zw" podUID="dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc"
Sep 10 15:16:05.403651 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:05.403421    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:16:05.403789 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:05.403696    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qzxr" podUID="8bd848e3-5919-4d0a-80c9-f2bd7f7db58b"
Sep 10 15:16:07.403656 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:07.403447    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:16:07.404108 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:07.403505    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:16:07.404108 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:07.403731    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s87zw" podUID="dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc"
Sep 10 15:16:07.404108 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:07.403534    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:16:07.404108 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:07.403857    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhkb" podUID="17387da0-5265-4e58-9383-ccc3e8cbf5ea"
Sep 10 15:16:07.404108 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:07.403915    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qzxr" podUID="8bd848e3-5919-4d0a-80c9-f2bd7f7db58b"
Sep 10 15:16:08.512188 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:08.511998    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl" event={"ID":"e4577fae-7022-4064-98d2-99edb6be056c","Type":"ContainerStarted","Data":"f8a4b887745cd10fa15127aad0d3120864f5c94594a144b6bc61d864d510bc84"}
Sep 10 15:16:08.512922 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:08.512267    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl" event={"ID":"e4577fae-7022-4064-98d2-99edb6be056c","Type":"ContainerStarted","Data":"1963253c4330c8e353f654ab67b63245fcf38f1ef12383201fa88688477fc053"}
Sep 10 15:16:08.512922 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:08.512318    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl" event={"ID":"e4577fae-7022-4064-98d2-99edb6be056c","Type":"ContainerStarted","Data":"8b44cd43bfacc8aa9684a55ead875f68b1a4da11f1b63e3f3339f1839c6fb293"}
Sep 10 15:16:08.513548 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:08.513477    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bj7vg" event={"ID":"4ba47f2c-aa01-49e8-8b3a-2534c01624a4","Type":"ContainerStarted","Data":"9495b1eae15413363fa880588fb3637a2f4a9cd3a202742358aef7f86e99450c"}
Sep 10 15:16:08.515143 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:08.515121    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt" event={"ID":"6065b3cf-3d6f-4d96-b5f1-86e5193a42da","Type":"ContainerStarted","Data":"dbfdcdc79e45c8d69486f8473c99c774fa0e9fd96114fecf63a42404e9c73b2b"}
Sep 10 15:16:08.516866 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:08.516846    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tm2gm" event={"ID":"a965c17d-32ee-4814-8067-df4b73b8ea0a","Type":"ContainerStarted","Data":"7970a9136a1276904962fcbaabe36fb06104469c218117744890c20e18f2ffcd"}
Sep 10 15:16:08.518533 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:08.518511    2574 generic.go:356] "Generic (PLEG): container finished" podID="1e265d02-f5f7-4c23-9d76-a93bcd720de2" containerID="6fc76783926420d63efe839b3f03c639aab7cbce89670f2f2b919f0f260b0548" exitCode=0
Sep 10 15:16:08.518635 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:08.518581    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxnt8" event={"ID":"1e265d02-f5f7-4c23-9d76-a93bcd720de2","Type":"ContainerDied","Data":"6fc76783926420d63efe839b3f03c639aab7cbce89670f2f2b919f0f260b0548"}
Sep 10 15:16:08.520095 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:08.520022    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9ctw2" event={"ID":"a7ffe6a3-b6d6-4481-b023-95ad5eae05fc","Type":"ContainerStarted","Data":"6882636d465a00b00829ba75144c1538ac4f2a0b54f672d1272d2c9dec500cbb"}
Sep 10 15:16:08.521549 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:08.521527    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c2rmh" event={"ID":"9486873e-4c69-4b47-b22b-7e820e7d2ce1","Type":"ContainerStarted","Data":"ad510beb09d5bf11c8c5dfb430504ebd2c5a1bfb4b58c152e92fd1af58c35541"}
Sep 10 15:16:08.522919 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:08.522899    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sm8v7" event={"ID":"3de18da0-a224-4960-998d-145e892f0916","Type":"ContainerStarted","Data":"1839b4e71fbd8bf2a599bb35ddef6c4e8d48e1d9c24e9564caa1c52d1be6fe30"}
Sep 10 15:16:08.531008 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:08.530731    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bj7vg" podStartSLOduration=3.794444765 podStartE2EDuration="21.530714779s" totalImagesPullingTime="17.736270014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:16:08.530595012 +0000 UTC m=+21.580393521" watchObservedRunningTime="2026-09-10 15:16:08.530714779 +0000 UTC m=+21.580513290"
Sep 10 15:16:08.531008 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:08.530872    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-37.ec2.internal" podStartSLOduration=20.530863016 podStartE2EDuration="20.530863016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:15:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:15:52.505187297 +0000 UTC m=+5.554985807" watchObservedRunningTime="2026-09-10 15:16:08.530863016 +0000 UTC m=+21.580661524"
Sep 10 15:16:08.549448 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:08.549404    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sm8v7" podStartSLOduration=3.8053058379999998 podStartE2EDuration="21.549388842s" totalImagesPullingTime="17.744083004s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:16:08.549332619 +0000 UTC m=+21.599131127" watchObservedRunningTime="2026-09-10 15:16:08.549388842 +0000 UTC m=+21.599187349"
Sep 10 15:16:08.584850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:08.584809    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tm2gm" podStartSLOduration=7.716462747 podStartE2EDuration="21.584794272s" totalImagesPullingTime="13.868331525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:16:08.584388581 +0000 UTC m=+21.634187088" watchObservedRunningTime="2026-09-10 15:16:08.584794272 +0000 UTC m=+21.634592779"
Sep 10 15:16:08.620863 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:08.620820    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9ctw2" podStartSLOduration=3.880186077 podStartE2EDuration="21.620804279s" totalImagesPullingTime="17.740618202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:16:08.599312648 +0000 UTC m=+21.649111157" watchObservedRunningTime="2026-09-10 15:16:08.620804279 +0000 UTC m=+21.670602786"
Sep 10 15:16:08.621010 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:08.620990    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-c2rmh" podStartSLOduration=3.833712951 podStartE2EDuration="21.620985603s" totalImagesPullingTime="17.787272652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:16:08.620655756 +0000 UTC m=+21.670454264" watchObservedRunningTime="2026-09-10 15:16:08.620985603 +0000 UTC m=+21.670784137"
Sep 10 15:16:09.403317 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:09.403286    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:16:09.403482 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:09.403291    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:16:09.403482 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:09.403415    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:16:09.403482 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:09.403414    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhkb" podUID="17387da0-5265-4e58-9383-ccc3e8cbf5ea"
Sep 10 15:16:09.403578 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:09.403495    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qzxr" podUID="8bd848e3-5919-4d0a-80c9-f2bd7f7db58b"
Sep 10 15:16:09.403612 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:09.403583    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s87zw" podUID="dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc"
Sep 10 15:16:09.528636 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:09.528595    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl" event={"ID":"e4577fae-7022-4064-98d2-99edb6be056c","Type":"ContainerStarted","Data":"282786ef87986cd384b2d792671ecd309292f72020a69f880d0ee21da2d97a6a"}
Sep 10 15:16:09.529172 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:09.528665    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl" event={"ID":"e4577fae-7022-4064-98d2-99edb6be056c","Type":"ContainerStarted","Data":"f62b507451281bad2632d15e00c8fc356a2b8ac196a9e19220dcc7ed2c3285d4"}
Sep 10 15:16:09.529172 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:09.528695    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl" event={"ID":"e4577fae-7022-4064-98d2-99edb6be056c","Type":"ContainerStarted","Data":"4496627c3bd9fbc1be4f79edc4d44a62629c86fbae12f6acc37958345a1862a0"}
Sep 10 15:16:09.530141 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:09.530112    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n4hgt" event={"ID":"53f7663e-7918-49a1-a518-841a4119398c","Type":"ContainerStarted","Data":"e1d798ae1da92b0b3958eba48d38343747ea865db21e2839872ca354fecb5e1f"}
Sep 10 15:16:09.550194 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:09.550133    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n4hgt" podStartSLOduration=4.821599251 podStartE2EDuration="22.550118412s" totalImagesPullingTime="17.728519161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:16:09.549953808 +0000 UTC m=+22.599752316" watchObservedRunningTime="2026-09-10 15:16:09.550118412 +0000 UTC m=+22.599916922"
Sep 10 15:16:09.608266 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:09.608230    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tm2gm"
Sep 10 15:16:09.609029 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:09.609005    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tm2gm"
Sep 10 15:16:09.702366 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:09.702149    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 15:16:10.355244 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:10.355140    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T15:16:09.702360828Z","UUID":"125e0382-a86d-4fb2-be98-04672d375029","Handler":null,"Name":"","Endpoint":""}
Sep 10 15:16:10.357336 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:10.357310    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 15:16:10.357475 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:10.357346    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 15:16:10.535247 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:10.535206    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt" event={"ID":"6065b3cf-3d6f-4d96-b5f1-86e5193a42da","Type":"ContainerStarted","Data":"9985810b4fc6aa130ab64f5ea8e0f4935448ce71cc73a678bdf9029e3f28038a"}
Sep 10 15:16:10.535761 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:10.535627    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tm2gm"
Sep 10 15:16:10.536490 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:10.536470    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tm2gm"
Sep 10 15:16:11.403749 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:11.403717    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:16:11.403749 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:11.403743    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:16:11.403959 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:11.403720    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:16:11.403959 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:11.403817    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhkb" podUID="17387da0-5265-4e58-9383-ccc3e8cbf5ea"
Sep 10 15:16:11.403959 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:11.403905    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qzxr" podUID="8bd848e3-5919-4d0a-80c9-f2bd7f7db58b"
Sep 10 15:16:11.404063 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:11.403988    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s87zw" podUID="dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc"
Sep 10 15:16:11.542554 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:11.542518    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl" event={"ID":"e4577fae-7022-4064-98d2-99edb6be056c","Type":"ContainerStarted","Data":"c1a81136541d589e4457bb098ee0fc627d96df0e11f1d04f36f4ef52e317a50d"}
Sep 10 15:16:11.544911 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:11.544865    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt" event={"ID":"6065b3cf-3d6f-4d96-b5f1-86e5193a42da","Type":"ContainerStarted","Data":"58ea40eec9dc45b9c9fbe12db09b4135fd326153f7940bf7b7c52efbf87e526d"}
Sep 10 15:16:11.572524 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:11.572469    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvktt" podStartSLOduration=4.650939336 podStartE2EDuration="24.572448871s" totalImagesPullingTime="19.921509535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:15:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:16:11.571869859 +0000 UTC m=+24.621668366" watchObservedRunningTime="2026-09-10 15:16:11.572448871 +0000 UTC m=+24.622247382"
Sep 10 15:16:13.060740 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:13.060706    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tm2gm_a965c17d-32ee-4814-8067-df4b73b8ea0a/konnectivity-agent/0.log" limit=1024
Sep 10 15:16:13.137609 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:13.137575    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tm2gm_a965c17d-32ee-4814-8067-df4b73b8ea0a/konnectivity-agent/0.log" limit=1024
Sep 10 15:16:13.403385 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:13.402741    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:16:13.403385 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:13.402747    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:16:13.403385 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:13.402851    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhkb" podUID="17387da0-5265-4e58-9383-ccc3e8cbf5ea"
Sep 10 15:16:13.403385 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:13.402747    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:16:13.403385 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:13.402954    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s87zw" podUID="dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc"
Sep 10 15:16:13.403385 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:13.403032    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qzxr" podUID="8bd848e3-5919-4d0a-80c9-f2bd7f7db58b"
Sep 10 15:16:13.557511 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:13.556532    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl" event={"ID":"e4577fae-7022-4064-98d2-99edb6be056c","Type":"ContainerStarted","Data":"abfda12b8e91867be65f99db6cc51e4642b9ab827ab052f7e6744c682b7a57f0"}
Sep 10 15:16:13.557511 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:13.557065    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:16:13.557511 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:13.557126    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:16:13.557511 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:13.557175    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:16:13.574401 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:13.574325    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:16:13.575309 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:13.575289    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:16:13.588072 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:13.588015    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl" podStartSLOduration=8.816111409 podStartE2EDuration="26.588000283s" totalImagesPullingTime="17.771888874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:16:13.587063999 +0000 UTC m=+26.636862509" watchObservedRunningTime="2026-09-10 15:16:13.588000283 +0000 UTC m=+26.637798791"
Sep 10 15:16:14.560879 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:14.560844    2574 generic.go:356] "Generic (PLEG): container finished" podID="1e265d02-f5f7-4c23-9d76-a93bcd720de2" containerID="83a9a3d8150fdbec46af868e858f681260c47c157141957782e9c1c87d3d5f5e" exitCode=0
Sep 10 15:16:14.561356 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:14.560944    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxnt8" event={"ID":"1e265d02-f5f7-4c23-9d76-a93bcd720de2","Type":"ContainerDied","Data":"83a9a3d8150fdbec46af868e858f681260c47c157141957782e9c1c87d3d5f5e"}
Sep 10 15:16:15.274589 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:15.274556    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s87zw"]
Sep 10 15:16:15.274777 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:15.274734    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:16:15.274881 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:15.274856    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s87zw" podUID="dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc"
Sep 10 15:16:15.277635 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:15.277607    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jfhkb"]
Sep 10 15:16:15.277794 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:15.277717    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:16:15.277865 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:15.277828    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhkb" podUID="17387da0-5265-4e58-9383-ccc3e8cbf5ea"
Sep 10 15:16:15.278441 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:15.278419    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9qzxr"]
Sep 10 15:16:15.278557 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:15.278505    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:16:15.278618 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:15.278580    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qzxr" podUID="8bd848e3-5919-4d0a-80c9-f2bd7f7db58b"
Sep 10 15:16:15.565750 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:15.565561    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxnt8" event={"ID":"1e265d02-f5f7-4c23-9d76-a93bcd720de2","Type":"ContainerStarted","Data":"caa51758f15a926affb21850c79d167dc8eb749b091cdfc99addc3d11a3e74b8"}
Sep 10 15:16:16.402908 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:16.402831    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:16:16.403069 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:16.402952    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qzxr" podUID="8bd848e3-5919-4d0a-80c9-f2bd7f7db58b"
Sep 10 15:16:16.467388 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:16.467356    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tm2gm_a965c17d-32ee-4814-8067-df4b73b8ea0a/konnectivity-agent/0.log" limit=1024
Sep 10 15:16:16.527775 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:16.527742    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tm2gm_a965c17d-32ee-4814-8067-df4b73b8ea0a/konnectivity-agent/0.log" limit=1024
Sep 10 15:16:16.569771 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:16.569733    2574 generic.go:356] "Generic (PLEG): container finished" podID="1e265d02-f5f7-4c23-9d76-a93bcd720de2" containerID="caa51758f15a926affb21850c79d167dc8eb749b091cdfc99addc3d11a3e74b8" exitCode=0
Sep 10 15:16:16.570148 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:16.569801    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxnt8" event={"ID":"1e265d02-f5f7-4c23-9d76-a93bcd720de2","Type":"ContainerDied","Data":"caa51758f15a926affb21850c79d167dc8eb749b091cdfc99addc3d11a3e74b8"}
Sep 10 15:16:17.372974 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:17.372888    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tm2gm_a965c17d-32ee-4814-8067-df4b73b8ea0a/konnectivity-agent/0.log" limit=1024
Sep 10 15:16:17.404621 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:17.404589    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:16:17.404753 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:17.404633    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:16:17.404753 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:17.404720    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s87zw" podUID="dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc"
Sep 10 15:16:17.404824 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:17.404810    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhkb" podUID="17387da0-5265-4e58-9383-ccc3e8cbf5ea"
Sep 10 15:16:17.473790 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:17.473759    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tm2gm_a965c17d-32ee-4814-8067-df4b73b8ea0a/konnectivity-agent/0.log" limit=1024
Sep 10 15:16:18.403493 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:18.403469    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:16:18.403909 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:18.403563    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qzxr" podUID="8bd848e3-5919-4d0a-80c9-f2bd7f7db58b"
Sep 10 15:16:18.577879 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:18.577845    2574 generic.go:356] "Generic (PLEG): container finished" podID="1e265d02-f5f7-4c23-9d76-a93bcd720de2" containerID="8f1bba2419b794911bc6dc6acafe5575f84883c5bdd8d2040065a84e0b0e05dc" exitCode=0
Sep 10 15:16:18.578033 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:18.577907    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxnt8" event={"ID":"1e265d02-f5f7-4c23-9d76-a93bcd720de2","Type":"ContainerDied","Data":"8f1bba2419b794911bc6dc6acafe5575f84883c5bdd8d2040065a84e0b0e05dc"}
Sep 10 15:16:19.403680 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:19.403644    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:16:19.404126 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:19.403759    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s87zw" podUID="dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc"
Sep 10 15:16:19.404126 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:19.403825    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:16:19.404126 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:19.403954    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhkb" podUID="17387da0-5265-4e58-9383-ccc3e8cbf5ea"
Sep 10 15:16:20.403573 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.403537    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:16:20.403855 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:20.403668    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qzxr" podUID="8bd848e3-5919-4d0a-80c9-f2bd7f7db58b"
Sep 10 15:16:20.733280 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.733253    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-37.ec2.internal" event="NodeReady"
Sep 10 15:16:20.733427 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.733374    2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 15:16:20.790015 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.789981    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ppwfd"]
Sep 10 15:16:20.791906 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.791883    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:16:20.795296 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.795271    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4q2px\""
Sep 10 15:16:20.795400 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.795314    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 15:16:20.795826 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.795795    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 15:16:20.801407 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.801387    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xlrmn"]
Sep 10 15:16:20.803225 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.803207    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xlrmn"
Sep 10 15:16:20.806201 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.806179    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-46mx6\""
Sep 10 15:16:20.806298 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.806275    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 15:16:20.806636 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.806618    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 15:16:20.810460 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.810438    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ppwfd"]
Sep 10 15:16:20.811771 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.811751    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 15:16:20.819249 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.819229    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xlrmn"]
Sep 10 15:16:20.939532 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.939450    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tm2gm_a965c17d-32ee-4814-8067-df4b73b8ea0a/konnectivity-agent/0.log" limit=1024
Sep 10 15:16:20.940405 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.940368    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f467c0b7-a81b-441e-b76f-288d7ade6d46-config-volume\") pod \"dns-default-ppwfd\" (UID: \"f467c0b7-a81b-441e-b76f-288d7ade6d46\") " pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:16:20.940405 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.940404    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f467c0b7-a81b-441e-b76f-288d7ade6d46-metrics-tls\") pod \"dns-default-ppwfd\" (UID: \"f467c0b7-a81b-441e-b76f-288d7ade6d46\") " pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:16:20.940405 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.940436    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f467c0b7-a81b-441e-b76f-288d7ade6d46-tmp-dir\") pod \"dns-default-ppwfd\" (UID: \"f467c0b7-a81b-441e-b76f-288d7ade6d46\") " pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:16:20.940703 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.940482    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq82n\" (UniqueName: \"kubernetes.io/projected/88a69307-bfe3-4f8a-b5c3-f9387e0d66f0-kube-api-access-zq82n\") pod \"ingress-canary-xlrmn\" (UID: \"88a69307-bfe3-4f8a-b5c3-f9387e0d66f0\") " pod="openshift-ingress-canary/ingress-canary-xlrmn"
Sep 10 15:16:20.940703 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.940511    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88a69307-bfe3-4f8a-b5c3-f9387e0d66f0-cert\") pod \"ingress-canary-xlrmn\" (UID: \"88a69307-bfe3-4f8a-b5c3-f9387e0d66f0\") " pod="openshift-ingress-canary/ingress-canary-xlrmn"
Sep 10 15:16:20.940703 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:20.940552    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j97kb\" (UniqueName: \"kubernetes.io/projected/f467c0b7-a81b-441e-b76f-288d7ade6d46-kube-api-access-j97kb\") pod \"dns-default-ppwfd\" (UID: \"f467c0b7-a81b-441e-b76f-288d7ade6d46\") " pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:16:21.040006 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.039972    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tm2gm_a965c17d-32ee-4814-8067-df4b73b8ea0a/konnectivity-agent/0.log" limit=1024
Sep 10 15:16:21.040974 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.040946    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f467c0b7-a81b-441e-b76f-288d7ade6d46-config-volume\") pod \"dns-default-ppwfd\" (UID: \"f467c0b7-a81b-441e-b76f-288d7ade6d46\") " pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:16:21.041109 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.040987    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f467c0b7-a81b-441e-b76f-288d7ade6d46-metrics-tls\") pod \"dns-default-ppwfd\" (UID: \"f467c0b7-a81b-441e-b76f-288d7ade6d46\") " pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:16:21.041109 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.041019    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f467c0b7-a81b-441e-b76f-288d7ade6d46-tmp-dir\") pod \"dns-default-ppwfd\" (UID: \"f467c0b7-a81b-441e-b76f-288d7ade6d46\") " pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:16:21.041109 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.041057    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq82n\" (UniqueName: \"kubernetes.io/projected/88a69307-bfe3-4f8a-b5c3-f9387e0d66f0-kube-api-access-zq82n\") pod \"ingress-canary-xlrmn\" (UID: \"88a69307-bfe3-4f8a-b5c3-f9387e0d66f0\") " pod="openshift-ingress-canary/ingress-canary-xlrmn"
Sep 10 15:16:21.041109 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.041085    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88a69307-bfe3-4f8a-b5c3-f9387e0d66f0-cert\") pod \"ingress-canary-xlrmn\" (UID: \"88a69307-bfe3-4f8a-b5c3-f9387e0d66f0\") " pod="openshift-ingress-canary/ingress-canary-xlrmn"
Sep 10 15:16:21.041109 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.041109    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j97kb\" (UniqueName: \"kubernetes.io/projected/f467c0b7-a81b-441e-b76f-288d7ade6d46-kube-api-access-j97kb\") pod \"dns-default-ppwfd\" (UID: \"f467c0b7-a81b-441e-b76f-288d7ade6d46\") " pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:16:21.041345 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:21.041144    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 15:16:21.041345 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:21.041208    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f467c0b7-a81b-441e-b76f-288d7ade6d46-metrics-tls podName:f467c0b7-a81b-441e-b76f-288d7ade6d46 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:21.541192695 +0000 UTC m=+34.590991195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f467c0b7-a81b-441e-b76f-288d7ade6d46-metrics-tls") pod "dns-default-ppwfd" (UID: "f467c0b7-a81b-441e-b76f-288d7ade6d46") : secret "dns-default-metrics-tls" not found
Sep 10 15:16:21.041561 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.041538    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f467c0b7-a81b-441e-b76f-288d7ade6d46-tmp-dir\") pod \"dns-default-ppwfd\" (UID: \"f467c0b7-a81b-441e-b76f-288d7ade6d46\") " pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:16:21.041616 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.041562    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f467c0b7-a81b-441e-b76f-288d7ade6d46-config-volume\") pod \"dns-default-ppwfd\" (UID: \"f467c0b7-a81b-441e-b76f-288d7ade6d46\") " pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:16:21.046618 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.046498    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88a69307-bfe3-4f8a-b5c3-f9387e0d66f0-cert\") pod \"ingress-canary-xlrmn\" (UID: \"88a69307-bfe3-4f8a-b5c3-f9387e0d66f0\") " pod="openshift-ingress-canary/ingress-canary-xlrmn"
Sep 10 15:16:21.054159 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.054127    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j97kb\" (UniqueName: \"kubernetes.io/projected/f467c0b7-a81b-441e-b76f-288d7ade6d46-kube-api-access-j97kb\") pod \"dns-default-ppwfd\" (UID: \"f467c0b7-a81b-441e-b76f-288d7ade6d46\") " pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:16:21.054276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.054170    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq82n\" (UniqueName: \"kubernetes.io/projected/88a69307-bfe3-4f8a-b5c3-f9387e0d66f0-kube-api-access-zq82n\") pod \"ingress-canary-xlrmn\" (UID: \"88a69307-bfe3-4f8a-b5c3-f9387e0d66f0\") " pod="openshift-ingress-canary/ingress-canary-xlrmn"
Sep 10 15:16:21.113696 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.113670    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xlrmn"
Sep 10 15:16:21.142392 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.142360    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcgwn\" (UniqueName: \"kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn\") pod \"network-check-target-jfhkb\" (UID: \"17387da0-5265-4e58-9383-ccc3e8cbf5ea\") " pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:16:21.142514 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.142403    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs\") pod \"network-metrics-daemon-s87zw\" (UID: \"dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc\") " pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:16:21.142514 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.142429    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret\") pod \"global-pull-secret-syncer-9qzxr\" (UID: \"8bd848e3-5919-4d0a-80c9-f2bd7f7db58b\") " pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:16:21.142594 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:21.142531    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 15:16:21.142594 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:21.142532    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:16:21.142594 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:21.142574    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 15:16:21.142706 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:21.142605    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 15:16:21.142706 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:21.142622    2574 projected.go:196] Error preparing data for projected volume kube-api-access-qcgwn for pod openshift-network-diagnostics/network-check-target-jfhkb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:16:21.142706 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:21.142584    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret podName:8bd848e3-5919-4d0a-80c9-f2bd7f7db58b nodeName:}" failed. No retries permitted until 2026-09-10 15:16:53.142571085 +0000 UTC m=+66.192369575 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret") pod "global-pull-secret-syncer-9qzxr" (UID: "8bd848e3-5919-4d0a-80c9-f2bd7f7db58b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 15:16:21.142814 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:21.142705    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs podName:dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc nodeName:}" failed. No retries permitted until 2026-09-10 15:16:53.142684685 +0000 UTC m=+66.192483182 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs") pod "network-metrics-daemon-s87zw" (UID: "dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:16:21.142814 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:21.142731    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn podName:17387da0-5265-4e58-9383-ccc3e8cbf5ea nodeName:}" failed. No retries permitted until 2026-09-10 15:16:53.142720777 +0000 UTC m=+66.192519277 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qcgwn" (UniqueName: "kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn") pod "network-check-target-jfhkb" (UID: "17387da0-5265-4e58-9383-ccc3e8cbf5ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:16:21.291471 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.291435    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tm2gm_a965c17d-32ee-4814-8067-df4b73b8ea0a/konnectivity-agent/0.log" limit=1024
Sep 10 15:16:21.383563 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.383526    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tm2gm_a965c17d-32ee-4814-8067-df4b73b8ea0a/konnectivity-agent/0.log" limit=1024
Sep 10 15:16:21.395764 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.395739    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xlrmn"]
Sep 10 15:16:21.399852 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:16:21.399822    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88a69307_bfe3_4f8a_b5c3_f9387e0d66f0.slice/crio-6e1fb5ec7f921dbc1b1806a5cbc058aeb268e39cd193b0c4548f17b1562d306c WatchSource:0}: Error finding container 6e1fb5ec7f921dbc1b1806a5cbc058aeb268e39cd193b0c4548f17b1562d306c: Status 404 returned error can't find the container with id 6e1fb5ec7f921dbc1b1806a5cbc058aeb268e39cd193b0c4548f17b1562d306c
Sep 10 15:16:21.406703 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.406680    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:16:21.407197 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.406715    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:16:21.409857 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.409836    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 15:16:21.409984 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.409870    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d5wmh\""
Sep 10 15:16:21.409984 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.409942    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 15:16:21.410224 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.410206    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 15:16:21.411334 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.411316    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-96bxt\""
Sep 10 15:16:21.545965 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.545870    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f467c0b7-a81b-441e-b76f-288d7ade6d46-metrics-tls\") pod \"dns-default-ppwfd\" (UID: \"f467c0b7-a81b-441e-b76f-288d7ade6d46\") " pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:16:21.546126 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:21.546040    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 15:16:21.546126 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:21.546099    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f467c0b7-a81b-441e-b76f-288d7ade6d46-metrics-tls podName:f467c0b7-a81b-441e-b76f-288d7ade6d46 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:22.546083024 +0000 UTC m=+35.595881532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f467c0b7-a81b-441e-b76f-288d7ade6d46-metrics-tls") pod "dns-default-ppwfd" (UID: "f467c0b7-a81b-441e-b76f-288d7ade6d46") : secret "dns-default-metrics-tls" not found
Sep 10 15:16:21.585982 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:21.585948    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xlrmn" event={"ID":"88a69307-bfe3-4f8a-b5c3-f9387e0d66f0","Type":"ContainerStarted","Data":"6e1fb5ec7f921dbc1b1806a5cbc058aeb268e39cd193b0c4548f17b1562d306c"}
Sep 10 15:16:22.402965 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:22.402909    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:16:22.406125 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:22.406100    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 15:16:22.553392 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:22.553361    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f467c0b7-a81b-441e-b76f-288d7ade6d46-metrics-tls\") pod \"dns-default-ppwfd\" (UID: \"f467c0b7-a81b-441e-b76f-288d7ade6d46\") " pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:16:22.553970 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:22.553529    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 15:16:22.553970 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:22.553609    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f467c0b7-a81b-441e-b76f-288d7ade6d46-metrics-tls podName:f467c0b7-a81b-441e-b76f-288d7ade6d46 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:24.553589125 +0000 UTC m=+37.603387610 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f467c0b7-a81b-441e-b76f-288d7ade6d46-metrics-tls") pod "dns-default-ppwfd" (UID: "f467c0b7-a81b-441e-b76f-288d7ade6d46") : secret "dns-default-metrics-tls" not found
Sep 10 15:16:23.594528 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:23.594484    2574 generic.go:356] "Generic (PLEG): container finished" podID="1e265d02-f5f7-4c23-9d76-a93bcd720de2" containerID="2869571c3a8c9770ebeaa40988892fa6a5353481ebeb1e7441d5df144d535064" exitCode=0
Sep 10 15:16:23.595177 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:23.594526    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxnt8" event={"ID":"1e265d02-f5f7-4c23-9d76-a93bcd720de2","Type":"ContainerDied","Data":"2869571c3a8c9770ebeaa40988892fa6a5353481ebeb1e7441d5df144d535064"}
Sep 10 15:16:24.569122 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:24.569081    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f467c0b7-a81b-441e-b76f-288d7ade6d46-metrics-tls\") pod \"dns-default-ppwfd\" (UID: \"f467c0b7-a81b-441e-b76f-288d7ade6d46\") " pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:16:24.569266 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:24.569226    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 15:16:24.569318 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:24.569307    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f467c0b7-a81b-441e-b76f-288d7ade6d46-metrics-tls podName:f467c0b7-a81b-441e-b76f-288d7ade6d46 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:28.569290871 +0000 UTC m=+41.619089362 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f467c0b7-a81b-441e-b76f-288d7ade6d46-metrics-tls") pod "dns-default-ppwfd" (UID: "f467c0b7-a81b-441e-b76f-288d7ade6d46") : secret "dns-default-metrics-tls" not found
Sep 10 15:16:24.600254 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:24.600222    2574 generic.go:356] "Generic (PLEG): container finished" podID="1e265d02-f5f7-4c23-9d76-a93bcd720de2" containerID="0b2744d0d28b4083a94b802c0063b91aa228d2760b8cb61d06a10bb1c9f58106" exitCode=0
Sep 10 15:16:24.600611 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:24.600267    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxnt8" event={"ID":"1e265d02-f5f7-4c23-9d76-a93bcd720de2","Type":"ContainerDied","Data":"0b2744d0d28b4083a94b802c0063b91aa228d2760b8cb61d06a10bb1c9f58106"}
Sep 10 15:16:25.605865 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:25.605676    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxnt8" event={"ID":"1e265d02-f5f7-4c23-9d76-a93bcd720de2","Type":"ContainerStarted","Data":"d4c2ee423d63db623100fcc68a58d851add0eda3abbd6142de97b0d7ccea6642"}
Sep 10 15:16:25.631314 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:25.631266    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hxnt8" podStartSLOduration=9.468074689 podStartE2EDuration="38.631249935s" totalImagesPullingTime="29.163175246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:15:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:16:25.629993643 +0000 UTC m=+38.679792150" watchObservedRunningTime="2026-09-10 15:16:25.631249935 +0000 UTC m=+38.681048442"
Sep 10 15:16:26.609363 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:26.609328    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xlrmn" event={"ID":"88a69307-bfe3-4f8a-b5c3-f9387e0d66f0","Type":"ContainerStarted","Data":"3a47940e51de45040b3182782ac1f37fd49b515a7413966480f9bb8f9b06cbee"}
Sep 10 15:16:26.627024 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:26.626893    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xlrmn" podStartSLOduration=2.338659772 podStartE2EDuration="6.626873022s" totalImagesPullingTime="4.28821325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:16:26.626595902 +0000 UTC m=+39.676394409" watchObservedRunningTime="2026-09-10 15:16:26.626873022 +0000 UTC m=+39.676671531"
Sep 10 15:16:28.599124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:28.599074    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f467c0b7-a81b-441e-b76f-288d7ade6d46-metrics-tls\") pod \"dns-default-ppwfd\" (UID: \"f467c0b7-a81b-441e-b76f-288d7ade6d46\") " pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:16:28.599491 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:28.599229    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 15:16:28.599491 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:28.599293    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f467c0b7-a81b-441e-b76f-288d7ade6d46-metrics-tls podName:f467c0b7-a81b-441e-b76f-288d7ade6d46 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:36.599275907 +0000 UTC m=+49.649074398 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f467c0b7-a81b-441e-b76f-288d7ade6d46-metrics-tls") pod "dns-default-ppwfd" (UID: "f467c0b7-a81b-441e-b76f-288d7ade6d46") : secret "dns-default-metrics-tls" not found
Sep 10 15:16:29.304751 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.304711    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twc8q"]
Sep 10 15:16:29.348864 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.348826    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-bmscf"]
Sep 10 15:16:29.349060 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.348992    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twc8q"
Sep 10 15:16:29.351975 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.351948    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 10 15:16:29.351975 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.351965    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 10 15:16:29.352140 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.352003    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 10 15:16:29.352140 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.352009    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nr574\""
Sep 10 15:16:29.372676 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.372648    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-hl6dl"]
Sep 10 15:16:29.372796 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.372755    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-bmscf"
Sep 10 15:16:29.376030 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.376007    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 10 15:16:29.376252 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.376233    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 10 15:16:29.376347 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.376328    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 10 15:16:29.376551 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.376528    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 10 15:16:29.376645 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.376631    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-b9k9r\""
Sep 10 15:16:29.396844 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.396811    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twc8q"]
Sep 10 15:16:29.397006 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.396857    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-bmscf"]
Sep 10 15:16:29.397006 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.396876    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-hl6dl"]
Sep 10 15:16:29.397006 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.396949    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-hl6dl"
Sep 10 15:16:29.399997 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.399953    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 10 15:16:29.400133 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.400026    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 10 15:16:29.400133 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.400050    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jl8j6\""
Sep 10 15:16:29.400330 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.400316    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 10 15:16:29.400368 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.400332    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 10 15:16:29.414366 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.414337    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bc4569df6-ktjn7"]
Sep 10 15:16:29.436796 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.436759    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-jkz86"]
Sep 10 15:16:29.436983 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.436901    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.439908 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.439879    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 15:16:29.439908 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.439897    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sxzrd\""
Sep 10 15:16:29.439908 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.439881    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 15:16:29.440175 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.440026    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 15:16:29.446100 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.446080    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 15:16:29.460797 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.460773    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-jkz86"]
Sep 10 15:16:29.460797 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.460800    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bc4569df6-ktjn7"]
Sep 10 15:16:29.460951 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.460887    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-jkz86"
Sep 10 15:16:29.463634 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.463617    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-m96mg\""
Sep 10 15:16:29.505601 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.505568    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph925\" (UniqueName: \"kubernetes.io/projected/24c1b5a4-af41-477d-b635-5a9f877aa79e-kube-api-access-ph925\") pod \"kube-storage-version-migrator-operator-8d7dd4675-hl6dl\" (UID: \"24c1b5a4-af41-477d-b635-5a9f877aa79e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-hl6dl"
Sep 10 15:16:29.505767 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.505623    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/067ecc26-dbf0-48ce-b6e3-ef6ea52dd929-serving-cert\") pod \"service-ca-operator-859f94c4b-bmscf\" (UID: \"067ecc26-dbf0-48ce-b6e3-ef6ea52dd929\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-bmscf"
Sep 10 15:16:29.505767 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.505651    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g9xl\" (UniqueName: \"kubernetes.io/projected/067ecc26-dbf0-48ce-b6e3-ef6ea52dd929-kube-api-access-5g9xl\") pod \"service-ca-operator-859f94c4b-bmscf\" (UID: \"067ecc26-dbf0-48ce-b6e3-ef6ea52dd929\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-bmscf"
Sep 10 15:16:29.505767 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.505684    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5ec88fb-a404-41af-948d-7991ce803a9a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-twc8q\" (UID: \"d5ec88fb-a404-41af-948d-7991ce803a9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twc8q"
Sep 10 15:16:29.505767 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.505704    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24c1b5a4-af41-477d-b635-5a9f877aa79e-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-hl6dl\" (UID: \"24c1b5a4-af41-477d-b635-5a9f877aa79e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-hl6dl"
Sep 10 15:16:29.505767 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.505727    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24c1b5a4-af41-477d-b635-5a9f877aa79e-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-hl6dl\" (UID: \"24c1b5a4-af41-477d-b635-5a9f877aa79e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-hl6dl"
Sep 10 15:16:29.505767 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.505749    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/067ecc26-dbf0-48ce-b6e3-ef6ea52dd929-config\") pod \"service-ca-operator-859f94c4b-bmscf\" (UID: \"067ecc26-dbf0-48ce-b6e3-ef6ea52dd929\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-bmscf"
Sep 10 15:16:29.506044 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.505840    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c4n2\" (UniqueName: \"kubernetes.io/projected/d5ec88fb-a404-41af-948d-7991ce803a9a-kube-api-access-7c4n2\") pod \"cluster-samples-operator-7cdcfcf76c-twc8q\" (UID: \"d5ec88fb-a404-41af-948d-7991ce803a9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twc8q"
Sep 10 15:16:29.512847 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.512810    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-bh676"]
Sep 10 15:16:29.529151 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.529118    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh"]
Sep 10 15:16:29.529317 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.529249    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-bh676"
Sep 10 15:16:29.532189 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.532165    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 10 15:16:29.532515 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.532480    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5cq2j\""
Sep 10 15:16:29.532970 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.532951    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 10 15:16:29.533411 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.532963    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 10 15:16:29.533511 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.533159    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 10 15:16:29.538657 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.538639    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 10 15:16:29.542962 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.542940    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-c2d27"]
Sep 10 15:16:29.543056 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.543024    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh"
Sep 10 15:16:29.545917 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.545899    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 10 15:16:29.547073 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.547055    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lsqpr\""
Sep 10 15:16:29.547363 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.547346    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 15:16:29.547437 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.547364    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 15:16:29.547609 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.547591    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 10 15:16:29.561023 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.560968    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pvdcp"]
Sep 10 15:16:29.561119 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.561083    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27"
Sep 10 15:16:29.563916 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.563892    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9lc2k\""
Sep 10 15:16:29.564033 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.563952    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 15:16:29.564248 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.564222    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 10 15:16:29.564484 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.564468    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 10 15:16:29.564620 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.564516    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 15:16:29.579493 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.579471    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 10 15:16:29.581170 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.581152    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-d685f7754-28m8s"]
Sep 10 15:16:29.581276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.581262    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pvdcp"
Sep 10 15:16:29.583815 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.583794    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 10 15:16:29.583916 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.583819    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6c7wr\""
Sep 10 15:16:29.583916 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.583851    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 10 15:16:29.603269 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.603247    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-bh676"]
Sep 10 15:16:29.603622 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.603283    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pvdcp"]
Sep 10 15:16:29.603622 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.603303    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-c2d27"]
Sep 10 15:16:29.603622 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.603323    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh"]
Sep 10 15:16:29.603622 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.603342    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-d685f7754-28m8s"]
Sep 10 15:16:29.603622 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.603360    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:29.606432 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.606415    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgzv2\" (UniqueName: \"kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-kube-api-access-lgzv2\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.606513 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.606448    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c4n2\" (UniqueName: \"kubernetes.io/projected/d5ec88fb-a404-41af-948d-7991ce803a9a-kube-api-access-7c4n2\") pod \"cluster-samples-operator-7cdcfcf76c-twc8q\" (UID: \"d5ec88fb-a404-41af-948d-7991ce803a9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twc8q"
Sep 10 15:16:29.606513 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.606477    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/39bc4eb0-3627-4a43-9fab-6831317f06e9-installation-pull-secrets\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.606513 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.606495    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wsvh\" (UniqueName: \"kubernetes.io/projected/2840c3d6-bd89-4b8e-a96a-1cafd9b570a6-kube-api-access-2wsvh\") pod \"network-check-source-685456655f-jkz86\" (UID: \"2840c3d6-bd89-4b8e-a96a-1cafd9b570a6\") " pod="openshift-network-diagnostics/network-check-source-685456655f-jkz86"
Sep 10 15:16:29.606657 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.606547    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph925\" (UniqueName: \"kubernetes.io/projected/24c1b5a4-af41-477d-b635-5a9f877aa79e-kube-api-access-ph925\") pod \"kube-storage-version-migrator-operator-8d7dd4675-hl6dl\" (UID: \"24c1b5a4-af41-477d-b635-5a9f877aa79e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-hl6dl"
Sep 10 15:16:29.606657 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.606553    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 10 15:16:29.606657 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.606596    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 10 15:16:29.606657 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.606614    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/067ecc26-dbf0-48ce-b6e3-ef6ea52dd929-serving-cert\") pod \"service-ca-operator-859f94c4b-bmscf\" (UID: \"067ecc26-dbf0-48ce-b6e3-ef6ea52dd929\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-bmscf"
Sep 10 15:16:29.606846 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.606654    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g9xl\" (UniqueName: \"kubernetes.io/projected/067ecc26-dbf0-48ce-b6e3-ef6ea52dd929-kube-api-access-5g9xl\") pod \"service-ca-operator-859f94c4b-bmscf\" (UID: \"067ecc26-dbf0-48ce-b6e3-ef6ea52dd929\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-bmscf"
Sep 10 15:16:29.606846 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.606701    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5ec88fb-a404-41af-948d-7991ce803a9a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-twc8q\" (UID: \"d5ec88fb-a404-41af-948d-7991ce803a9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twc8q"
Sep 10 15:16:29.606846 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.606731    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/39bc4eb0-3627-4a43-9fab-6831317f06e9-image-registry-private-configuration\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.606846 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.606771    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24c1b5a4-af41-477d-b635-5a9f877aa79e-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-hl6dl\" (UID: \"24c1b5a4-af41-477d-b635-5a9f877aa79e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-hl6dl"
Sep 10 15:16:29.606846 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.606797    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.606846 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.606821    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-certificates\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.606846 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.606774    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 15:16:29.607176 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:29.606833    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 15:16:29.607176 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.606872    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/39bc4eb0-3627-4a43-9fab-6831317f06e9-ca-trust-extracted\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.607176 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.606967    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 10 15:16:29.607176 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.606975    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-bound-sa-token\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.607176 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.607033    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 10 15:16:29.607176 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:29.607025    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5ec88fb-a404-41af-948d-7991ce803a9a-samples-operator-tls podName:d5ec88fb-a404-41af-948d-7991ce803a9a nodeName:}" failed. No retries permitted until 2026-09-10 15:16:30.107002386 +0000 UTC m=+43.156800887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5ec88fb-a404-41af-948d-7991ce803a9a-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-twc8q" (UID: "d5ec88fb-a404-41af-948d-7991ce803a9a") : secret "samples-operator-tls" not found
Sep 10 15:16:29.607176 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.607101    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24c1b5a4-af41-477d-b635-5a9f877aa79e-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-hl6dl\" (UID: \"24c1b5a4-af41-477d-b635-5a9f877aa79e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-hl6dl"
Sep 10 15:16:29.607176 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.607126    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/067ecc26-dbf0-48ce-b6e3-ef6ea52dd929-config\") pod \"service-ca-operator-859f94c4b-bmscf\" (UID: \"067ecc26-dbf0-48ce-b6e3-ef6ea52dd929\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-bmscf"
Sep 10 15:16:29.607176 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.607140    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 15:16:29.607176 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.607178    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39bc4eb0-3627-4a43-9fab-6831317f06e9-trusted-ca\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.607564 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.607206    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4tw6r\""
Sep 10 15:16:29.607749 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.607729    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/067ecc26-dbf0-48ce-b6e3-ef6ea52dd929-config\") pod \"service-ca-operator-859f94c4b-bmscf\" (UID: \"067ecc26-dbf0-48ce-b6e3-ef6ea52dd929\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-bmscf"
Sep 10 15:16:29.607809 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.607729    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24c1b5a4-af41-477d-b635-5a9f877aa79e-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-hl6dl\" (UID: \"24c1b5a4-af41-477d-b635-5a9f877aa79e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-hl6dl"
Sep 10 15:16:29.610076 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.610042    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24c1b5a4-af41-477d-b635-5a9f877aa79e-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-hl6dl\" (UID: \"24c1b5a4-af41-477d-b635-5a9f877aa79e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-hl6dl"
Sep 10 15:16:29.610190 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.610099    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/067ecc26-dbf0-48ce-b6e3-ef6ea52dd929-serving-cert\") pod \"service-ca-operator-859f94c4b-bmscf\" (UID: \"067ecc26-dbf0-48ce-b6e3-ef6ea52dd929\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-bmscf"
Sep 10 15:16:29.629287 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.629262    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph925\" (UniqueName: \"kubernetes.io/projected/24c1b5a4-af41-477d-b635-5a9f877aa79e-kube-api-access-ph925\") pod \"kube-storage-version-migrator-operator-8d7dd4675-hl6dl\" (UID: \"24c1b5a4-af41-477d-b635-5a9f877aa79e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-hl6dl"
Sep 10 15:16:29.629434 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.629413    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g9xl\" (UniqueName: \"kubernetes.io/projected/067ecc26-dbf0-48ce-b6e3-ef6ea52dd929-kube-api-access-5g9xl\") pod \"service-ca-operator-859f94c4b-bmscf\" (UID: \"067ecc26-dbf0-48ce-b6e3-ef6ea52dd929\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-bmscf"
Sep 10 15:16:29.629481 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.629456    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c4n2\" (UniqueName: \"kubernetes.io/projected/d5ec88fb-a404-41af-948d-7991ce803a9a-kube-api-access-7c4n2\") pod \"cluster-samples-operator-7cdcfcf76c-twc8q\" (UID: \"d5ec88fb-a404-41af-948d-7991ce803a9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twc8q"
Sep 10 15:16:29.680667 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.680625    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-bmscf"
Sep 10 15:16:29.705252 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.705227    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-hl6dl"
Sep 10 15:16:29.708519 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.708494    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkbcv\" (UniqueName: \"kubernetes.io/projected/75b30207-2908-4328-bc6c-0b2b0bf59df0-kube-api-access-nkbcv\") pod \"volume-data-source-validator-695c895bd6-pvdcp\" (UID: \"75b30207-2908-4328-bc6c-0b2b0bf59df0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pvdcp"
Sep 10 15:16:29.708628 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.708526    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-metrics-certs\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:29.708628 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.708563    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.708628 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.708614    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/46fdc592-4de9-4212-8a71-e84cb6d48862-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-pshjh\" (UID: \"46fdc592-4de9-4212-8a71-e84cb6d48862\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh"
Sep 10 15:16:29.708779 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:29.708656    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 15:16:29.708779 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:29.708666    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bc4569df6-ktjn7: secret "image-registry-tls" not found
Sep 10 15:16:29.708779 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.708666    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-service-ca-bundle\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:29.708779 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.708684    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-default-certificate\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:29.708779 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:29.708710    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls podName:39bc4eb0-3627-4a43-9fab-6831317f06e9 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:30.208691028 +0000 UTC m=+43.258489514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls") pod "image-registry-6bc4569df6-ktjn7" (UID: "39bc4eb0-3627-4a43-9fab-6831317f06e9") : secret "image-registry-tls" not found
Sep 10 15:16:29.708779 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.708727    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2daa35c-0530-448c-82d6-51be02389e4b-tmp\") pod \"insights-operator-76bcd6ccf5-c2d27\" (UID: \"c2daa35c-0530-448c-82d6-51be02389e4b\") " pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27"
Sep 10 15:16:29.708779 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.708749    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-certificates\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.708779 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.708767    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c2daa35c-0530-448c-82d6-51be02389e4b-serving-cert\") pod \"insights-operator-76bcd6ccf5-c2d27\" (UID: \"c2daa35c-0530-448c-82d6-51be02389e4b\") " pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27"
Sep 10 15:16:29.709178 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.708792    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b6778d4-2e09-485a-af8f-8e4fe72225f3-serving-cert\") pod \"console-operator-85b454874b-bh676\" (UID: \"2b6778d4-2e09-485a-af8f-8e4fe72225f3\") " pod="openshift-console-operator/console-operator-85b454874b-bh676"
Sep 10 15:16:29.709178 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.708978    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/46fdc592-4de9-4212-8a71-e84cb6d48862-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-pshjh\" (UID: \"46fdc592-4de9-4212-8a71-e84cb6d48862\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh"
Sep 10 15:16:29.709178 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.709015    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39bc4eb0-3627-4a43-9fab-6831317f06e9-trusted-ca\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.709178 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.709047    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgzv2\" (UniqueName: \"kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-kube-api-access-lgzv2\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.709178 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.709170    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2daa35c-0530-448c-82d6-51be02389e4b-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-c2d27\" (UID: \"c2daa35c-0530-448c-82d6-51be02389e4b\") " pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27"
Sep 10 15:16:29.709407 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.709194    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8fdf\" (UniqueName: \"kubernetes.io/projected/c2daa35c-0530-448c-82d6-51be02389e4b-kube-api-access-p8fdf\") pod \"insights-operator-76bcd6ccf5-c2d27\" (UID: \"c2daa35c-0530-448c-82d6-51be02389e4b\") " pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27"
Sep 10 15:16:29.709407 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.709215    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/39bc4eb0-3627-4a43-9fab-6831317f06e9-installation-pull-secrets\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.709407 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.709244    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b6778d4-2e09-485a-af8f-8e4fe72225f3-config\") pod \"console-operator-85b454874b-bh676\" (UID: \"2b6778d4-2e09-485a-af8f-8e4fe72225f3\") " pod="openshift-console-operator/console-operator-85b454874b-bh676"
Sep 10 15:16:29.709407 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.709271    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b6778d4-2e09-485a-af8f-8e4fe72225f3-trusted-ca\") pod \"console-operator-85b454874b-bh676\" (UID: \"2b6778d4-2e09-485a-af8f-8e4fe72225f3\") " pod="openshift-console-operator/console-operator-85b454874b-bh676"
Sep 10 15:16:29.709407 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.709295    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/39bc4eb0-3627-4a43-9fab-6831317f06e9-ca-trust-extracted\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.709407 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.709333    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/39bc4eb0-3627-4a43-9fab-6831317f06e9-image-registry-private-configuration\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.709407 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.709352    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-certificates\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.709407 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.709374    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c2daa35c-0530-448c-82d6-51be02389e4b-snapshots\") pod \"insights-operator-76bcd6ccf5-c2d27\" (UID: \"c2daa35c-0530-448c-82d6-51be02389e4b\") " pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27"
Sep 10 15:16:29.709891 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.709420    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5cwb\" (UniqueName: \"kubernetes.io/projected/2b6778d4-2e09-485a-af8f-8e4fe72225f3-kube-api-access-f5cwb\") pod \"console-operator-85b454874b-bh676\" (UID: \"2b6778d4-2e09-485a-af8f-8e4fe72225f3\") " pod="openshift-console-operator/console-operator-85b454874b-bh676"
Sep 10 15:16:29.709891 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.709448    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-bound-sa-token\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.709891 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.709473    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2daa35c-0530-448c-82d6-51be02389e4b-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-c2d27\" (UID: \"c2daa35c-0530-448c-82d6-51be02389e4b\") " pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27"
Sep 10 15:16:29.709891 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.709496    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-stats-auth\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:29.709891 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.709518    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfm6q\" (UniqueName: \"kubernetes.io/projected/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-kube-api-access-qfm6q\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:29.709891 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.709561    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5hnp\" (UniqueName: \"kubernetes.io/projected/46fdc592-4de9-4212-8a71-e84cb6d48862-kube-api-access-s5hnp\") pod \"cluster-monitoring-operator-6cdcc96965-pshjh\" (UID: \"46fdc592-4de9-4212-8a71-e84cb6d48862\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh"
Sep 10 15:16:29.709891 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.709605    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wsvh\" (UniqueName: \"kubernetes.io/projected/2840c3d6-bd89-4b8e-a96a-1cafd9b570a6-kube-api-access-2wsvh\") pod \"network-check-source-685456655f-jkz86\" (UID: \"2840c3d6-bd89-4b8e-a96a-1cafd9b570a6\") " pod="openshift-network-diagnostics/network-check-source-685456655f-jkz86"
Sep 10 15:16:29.709891 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.709654    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/39bc4eb0-3627-4a43-9fab-6831317f06e9-ca-trust-extracted\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.710280 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.710028    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39bc4eb0-3627-4a43-9fab-6831317f06e9-trusted-ca\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.711739 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.711687    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/39bc4eb0-3627-4a43-9fab-6831317f06e9-image-registry-private-configuration\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.712066 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.712048    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/39bc4eb0-3627-4a43-9fab-6831317f06e9-installation-pull-secrets\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.719638 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.719618    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wsvh\" (UniqueName: \"kubernetes.io/projected/2840c3d6-bd89-4b8e-a96a-1cafd9b570a6-kube-api-access-2wsvh\") pod \"network-check-source-685456655f-jkz86\" (UID: \"2840c3d6-bd89-4b8e-a96a-1cafd9b570a6\") " pod="openshift-network-diagnostics/network-check-source-685456655f-jkz86"
Sep 10 15:16:29.719760 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.719744    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-bound-sa-token\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.719942 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.719910    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgzv2\" (UniqueName: \"kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-kube-api-access-lgzv2\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:29.769027 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.768953    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-jkz86"
Sep 10 15:16:29.810367 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.810329    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5cwb\" (UniqueName: \"kubernetes.io/projected/2b6778d4-2e09-485a-af8f-8e4fe72225f3-kube-api-access-f5cwb\") pod \"console-operator-85b454874b-bh676\" (UID: \"2b6778d4-2e09-485a-af8f-8e4fe72225f3\") " pod="openshift-console-operator/console-operator-85b454874b-bh676"
Sep 10 15:16:29.810367 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.810363    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2daa35c-0530-448c-82d6-51be02389e4b-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-c2d27\" (UID: \"c2daa35c-0530-448c-82d6-51be02389e4b\") " pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27"
Sep 10 15:16:29.810600 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.810384    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-stats-auth\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:29.810600 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.810408    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfm6q\" (UniqueName: \"kubernetes.io/projected/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-kube-api-access-qfm6q\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:29.810600 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.810452    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5hnp\" (UniqueName: \"kubernetes.io/projected/46fdc592-4de9-4212-8a71-e84cb6d48862-kube-api-access-s5hnp\") pod \"cluster-monitoring-operator-6cdcc96965-pshjh\" (UID: \"46fdc592-4de9-4212-8a71-e84cb6d48862\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh"
Sep 10 15:16:29.810600 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.810514    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkbcv\" (UniqueName: \"kubernetes.io/projected/75b30207-2908-4328-bc6c-0b2b0bf59df0-kube-api-access-nkbcv\") pod \"volume-data-source-validator-695c895bd6-pvdcp\" (UID: \"75b30207-2908-4328-bc6c-0b2b0bf59df0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pvdcp"
Sep 10 15:16:29.810600 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.810545    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-metrics-certs\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:29.810844 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.810609    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/46fdc592-4de9-4212-8a71-e84cb6d48862-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-pshjh\" (UID: \"46fdc592-4de9-4212-8a71-e84cb6d48862\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh"
Sep 10 15:16:29.810844 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.810657    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-service-ca-bundle\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:29.810844 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.810687    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-default-certificate\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:29.810844 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.810710    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2daa35c-0530-448c-82d6-51be02389e4b-tmp\") pod \"insights-operator-76bcd6ccf5-c2d27\" (UID: \"c2daa35c-0530-448c-82d6-51be02389e4b\") " pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27"
Sep 10 15:16:29.810844 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:29.810738    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 15:16:29.810844 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.810746    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c2daa35c-0530-448c-82d6-51be02389e4b-serving-cert\") pod \"insights-operator-76bcd6ccf5-c2d27\" (UID: \"c2daa35c-0530-448c-82d6-51be02389e4b\") " pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27"
Sep 10 15:16:29.810844 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.810774    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b6778d4-2e09-485a-af8f-8e4fe72225f3-serving-cert\") pod \"console-operator-85b454874b-bh676\" (UID: \"2b6778d4-2e09-485a-af8f-8e4fe72225f3\") " pod="openshift-console-operator/console-operator-85b454874b-bh676"
Sep 10 15:16:29.810844 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:29.810812    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-metrics-certs podName:d8b23ffc-2066-4cfe-a963-7d4b004ec8b8 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:30.31079044 +0000 UTC m=+43.360588951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-metrics-certs") pod "router-default-d685f7754-28m8s" (UID: "d8b23ffc-2066-4cfe-a963-7d4b004ec8b8") : secret "router-metrics-certs-default" not found
Sep 10 15:16:29.811284 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.810844    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/46fdc592-4de9-4212-8a71-e84cb6d48862-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-pshjh\" (UID: \"46fdc592-4de9-4212-8a71-e84cb6d48862\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh"
Sep 10 15:16:29.811284 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.810896    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2daa35c-0530-448c-82d6-51be02389e4b-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-c2d27\" (UID: \"c2daa35c-0530-448c-82d6-51be02389e4b\") " pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27"
Sep 10 15:16:29.811284 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.810943    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8fdf\" (UniqueName: \"kubernetes.io/projected/c2daa35c-0530-448c-82d6-51be02389e4b-kube-api-access-p8fdf\") pod \"insights-operator-76bcd6ccf5-c2d27\" (UID: \"c2daa35c-0530-448c-82d6-51be02389e4b\") " pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27"
Sep 10 15:16:29.811284 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.810978    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b6778d4-2e09-485a-af8f-8e4fe72225f3-config\") pod \"console-operator-85b454874b-bh676\" (UID: \"2b6778d4-2e09-485a-af8f-8e4fe72225f3\") " pod="openshift-console-operator/console-operator-85b454874b-bh676"
Sep 10 15:16:29.811284 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.811004    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b6778d4-2e09-485a-af8f-8e4fe72225f3-trusted-ca\") pod \"console-operator-85b454874b-bh676\" (UID: \"2b6778d4-2e09-485a-af8f-8e4fe72225f3\") " pod="openshift-console-operator/console-operator-85b454874b-bh676"
Sep 10 15:16:29.811284 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.811038    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c2daa35c-0530-448c-82d6-51be02389e4b-snapshots\") pod \"insights-operator-76bcd6ccf5-c2d27\" (UID: \"c2daa35c-0530-448c-82d6-51be02389e4b\") " pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27"
Sep 10 15:16:29.811284 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.811170    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2daa35c-0530-448c-82d6-51be02389e4b-tmp\") pod \"insights-operator-76bcd6ccf5-c2d27\" (UID: \"c2daa35c-0530-448c-82d6-51be02389e4b\") " pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27"
Sep 10 15:16:29.811617 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:29.811357    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 15:16:29.811617 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:29.811427    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fdc592-4de9-4212-8a71-e84cb6d48862-cluster-monitoring-operator-tls podName:46fdc592-4de9-4212-8a71-e84cb6d48862 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:30.311407604 +0000 UTC m=+43.361206112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/46fdc592-4de9-4212-8a71-e84cb6d48862-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-pshjh" (UID: "46fdc592-4de9-4212-8a71-e84cb6d48862") : secret "cluster-monitoring-operator-tls" not found
Sep 10 15:16:29.811617 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.811537    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2daa35c-0530-448c-82d6-51be02389e4b-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-c2d27\" (UID: \"c2daa35c-0530-448c-82d6-51be02389e4b\") " pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27"
Sep 10 15:16:29.811617 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.811571    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/46fdc592-4de9-4212-8a71-e84cb6d48862-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-pshjh\" (UID: \"46fdc592-4de9-4212-8a71-e84cb6d48862\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh"
Sep 10 15:16:29.811810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.811622    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2daa35c-0530-448c-82d6-51be02389e4b-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-c2d27\" (UID: \"c2daa35c-0530-448c-82d6-51be02389e4b\") " pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27"
Sep 10 15:16:29.811810 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:29.811666    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-service-ca-bundle podName:d8b23ffc-2066-4cfe-a963-7d4b004ec8b8 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:30.31164743 +0000 UTC m=+43.361445917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-service-ca-bundle") pod "router-default-d685f7754-28m8s" (UID: "d8b23ffc-2066-4cfe-a963-7d4b004ec8b8") : configmap references non-existent config key: service-ca.crt
Sep 10 15:16:29.811912 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.811864    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c2daa35c-0530-448c-82d6-51be02389e4b-snapshots\") pod \"insights-operator-76bcd6ccf5-c2d27\" (UID: \"c2daa35c-0530-448c-82d6-51be02389e4b\") " pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27"
Sep 10 15:16:29.812232 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.812204    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b6778d4-2e09-485a-af8f-8e4fe72225f3-config\") pod \"console-operator-85b454874b-bh676\" (UID: \"2b6778d4-2e09-485a-af8f-8e4fe72225f3\") " pod="openshift-console-operator/console-operator-85b454874b-bh676"
Sep 10 15:16:29.812534 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.812510    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b6778d4-2e09-485a-af8f-8e4fe72225f3-trusted-ca\") pod \"console-operator-85b454874b-bh676\" (UID: \"2b6778d4-2e09-485a-af8f-8e4fe72225f3\") " pod="openshift-console-operator/console-operator-85b454874b-bh676"
Sep 10 15:16:29.813445 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.813423    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-default-certificate\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:29.813716 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.813698    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-stats-auth\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:29.813794 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.813717    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c2daa35c-0530-448c-82d6-51be02389e4b-serving-cert\") pod \"insights-operator-76bcd6ccf5-c2d27\" (UID: \"c2daa35c-0530-448c-82d6-51be02389e4b\") " pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27"
Sep 10 15:16:29.814592 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.814561    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b6778d4-2e09-485a-af8f-8e4fe72225f3-serving-cert\") pod \"console-operator-85b454874b-bh676\" (UID: \"2b6778d4-2e09-485a-af8f-8e4fe72225f3\") " pod="openshift-console-operator/console-operator-85b454874b-bh676"
Sep 10 15:16:29.822503 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.822480    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfm6q\" (UniqueName: \"kubernetes.io/projected/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-kube-api-access-qfm6q\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:29.823063 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.823043    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8fdf\" (UniqueName: \"kubernetes.io/projected/c2daa35c-0530-448c-82d6-51be02389e4b-kube-api-access-p8fdf\") pod \"insights-operator-76bcd6ccf5-c2d27\" (UID: \"c2daa35c-0530-448c-82d6-51be02389e4b\") " pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27"
Sep 10 15:16:29.823173 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.823065    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5hnp\" (UniqueName: \"kubernetes.io/projected/46fdc592-4de9-4212-8a71-e84cb6d48862-kube-api-access-s5hnp\") pod \"cluster-monitoring-operator-6cdcc96965-pshjh\" (UID: \"46fdc592-4de9-4212-8a71-e84cb6d48862\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh"
Sep 10 15:16:29.823330 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.823310    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5cwb\" (UniqueName: \"kubernetes.io/projected/2b6778d4-2e09-485a-af8f-8e4fe72225f3-kube-api-access-f5cwb\") pod \"console-operator-85b454874b-bh676\" (UID: \"2b6778d4-2e09-485a-af8f-8e4fe72225f3\") " pod="openshift-console-operator/console-operator-85b454874b-bh676"
Sep 10 15:16:29.824183 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.824166    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkbcv\" (UniqueName: \"kubernetes.io/projected/75b30207-2908-4328-bc6c-0b2b0bf59df0-kube-api-access-nkbcv\") pod \"volume-data-source-validator-695c895bd6-pvdcp\" (UID: \"75b30207-2908-4328-bc6c-0b2b0bf59df0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pvdcp"
Sep 10 15:16:29.840281 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.840185    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-bh676"
Sep 10 15:16:29.871351 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.871321    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27"
Sep 10 15:16:29.890001 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.889971    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pvdcp"
Sep 10 15:16:29.991699 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:29.991668    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-bmscf"]
Sep 10 15:16:29.996443 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:16:29.996414    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod067ecc26_dbf0_48ce_b6e3_ef6ea52dd929.slice/crio-ddf47bd839c2b01a585872cae13ab4c284f2e26b1f02a405745d1fa40384726e WatchSource:0}: Error finding container ddf47bd839c2b01a585872cae13ab4c284f2e26b1f02a405745d1fa40384726e: Status 404 returned error can't find the container with id ddf47bd839c2b01a585872cae13ab4c284f2e26b1f02a405745d1fa40384726e
Sep 10 15:16:30.007213 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:30.007187    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-hl6dl"]
Sep 10 15:16:30.009776 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:16:30.009753    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24c1b5a4_af41_477d_b635_5a9f877aa79e.slice/crio-1d0bd496dc76f8cbbfb721b111f56b0ea557f143ea13287ef6d5180fdeb53ca4 WatchSource:0}: Error finding container 1d0bd496dc76f8cbbfb721b111f56b0ea557f143ea13287ef6d5180fdeb53ca4: Status 404 returned error can't find the container with id 1d0bd496dc76f8cbbfb721b111f56b0ea557f143ea13287ef6d5180fdeb53ca4
Sep 10 15:16:30.066031 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:30.065957    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-jkz86"]
Sep 10 15:16:30.068737 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:16:30.068711    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2840c3d6_bd89_4b8e_a96a_1cafd9b570a6.slice/crio-4e507b6524177d5322fbf5b3a6f8b468ef19a7fa09c49df6a578f88d783c7526 WatchSource:0}: Error finding container 4e507b6524177d5322fbf5b3a6f8b468ef19a7fa09c49df6a578f88d783c7526: Status 404 returned error can't find the container with id 4e507b6524177d5322fbf5b3a6f8b468ef19a7fa09c49df6a578f88d783c7526
Sep 10 15:16:30.114035 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:30.113995    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5ec88fb-a404-41af-948d-7991ce803a9a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-twc8q\" (UID: \"d5ec88fb-a404-41af-948d-7991ce803a9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twc8q"
Sep 10 15:16:30.114204 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:30.114149    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 15:16:30.114244 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:30.114226    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5ec88fb-a404-41af-948d-7991ce803a9a-samples-operator-tls podName:d5ec88fb-a404-41af-948d-7991ce803a9a nodeName:}" failed. No retries permitted until 2026-09-10 15:16:31.114211021 +0000 UTC m=+44.164009542 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5ec88fb-a404-41af-948d-7991ce803a9a-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-twc8q" (UID: "d5ec88fb-a404-41af-948d-7991ce803a9a") : secret "samples-operator-tls" not found
Sep 10 15:16:30.141766 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:30.141722    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-bh676"]
Sep 10 15:16:30.144364 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:16:30.144337    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b6778d4_2e09_485a_af8f_8e4fe72225f3.slice/crio-fddee78853c00f99d70000273776d0f45f864276332edc411f0499640003b3b7 WatchSource:0}: Error finding container fddee78853c00f99d70000273776d0f45f864276332edc411f0499640003b3b7: Status 404 returned error can't find the container with id fddee78853c00f99d70000273776d0f45f864276332edc411f0499640003b3b7
Sep 10 15:16:30.167249 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:30.167218    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-c2d27"]
Sep 10 15:16:30.170559 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:16:30.170532    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2daa35c_0530_448c_82d6_51be02389e4b.slice/crio-17a35571b30e3852bd5bd4b925df7c8c7619ac68ff79705ef540e6343e97bfdf WatchSource:0}: Error finding container 17a35571b30e3852bd5bd4b925df7c8c7619ac68ff79705ef540e6343e97bfdf: Status 404 returned error can't find the container with id 17a35571b30e3852bd5bd4b925df7c8c7619ac68ff79705ef540e6343e97bfdf
Sep 10 15:16:30.195332 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:30.195292    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pvdcp"]
Sep 10 15:16:30.197710 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:16:30.197681    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75b30207_2908_4328_bc6c_0b2b0bf59df0.slice/crio-02797444e9dc537c6e5dc8e1a5a5b092644baa5d0569596101f7bc0e818a41bc WatchSource:0}: Error finding container 02797444e9dc537c6e5dc8e1a5a5b092644baa5d0569596101f7bc0e818a41bc: Status 404 returned error can't find the container with id 02797444e9dc537c6e5dc8e1a5a5b092644baa5d0569596101f7bc0e818a41bc
Sep 10 15:16:30.214849 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:30.214821    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:30.215036 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:30.214988    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 15:16:30.215079 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:30.215040    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bc4569df6-ktjn7: secret "image-registry-tls" not found
Sep 10 15:16:30.215134 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:30.215099    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls podName:39bc4eb0-3627-4a43-9fab-6831317f06e9 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:31.215084637 +0000 UTC m=+44.264883146 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls") pod "image-registry-6bc4569df6-ktjn7" (UID: "39bc4eb0-3627-4a43-9fab-6831317f06e9") : secret "image-registry-tls" not found
Sep 10 15:16:30.316310 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:30.316226    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-metrics-certs\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:30.316475 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:30.316327    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-service-ca-bundle\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:30.316475 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:30.316374    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/46fdc592-4de9-4212-8a71-e84cb6d48862-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-pshjh\" (UID: \"46fdc592-4de9-4212-8a71-e84cb6d48862\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh"
Sep 10 15:16:30.316475 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:30.316391    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 15:16:30.316475 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:30.316459    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-metrics-certs podName:d8b23ffc-2066-4cfe-a963-7d4b004ec8b8 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:31.316443049 +0000 UTC m=+44.366241535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-metrics-certs") pod "router-default-d685f7754-28m8s" (UID: "d8b23ffc-2066-4cfe-a963-7d4b004ec8b8") : secret "router-metrics-certs-default" not found
Sep 10 15:16:30.316475 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:30.316474    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-service-ca-bundle podName:d8b23ffc-2066-4cfe-a963-7d4b004ec8b8 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:31.316468087 +0000 UTC m=+44.366266573 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-service-ca-bundle") pod "router-default-d685f7754-28m8s" (UID: "d8b23ffc-2066-4cfe-a963-7d4b004ec8b8") : configmap references non-existent config key: service-ca.crt
Sep 10 15:16:30.316475 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:30.316476    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 15:16:30.316700 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:30.316541    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fdc592-4de9-4212-8a71-e84cb6d48862-cluster-monitoring-operator-tls podName:46fdc592-4de9-4212-8a71-e84cb6d48862 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:31.316506345 +0000 UTC m=+44.366304848 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/46fdc592-4de9-4212-8a71-e84cb6d48862-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-pshjh" (UID: "46fdc592-4de9-4212-8a71-e84cb6d48862") : secret "cluster-monitoring-operator-tls" not found
Sep 10 15:16:30.622246 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:30.622145    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pvdcp" event={"ID":"75b30207-2908-4328-bc6c-0b2b0bf59df0","Type":"ContainerStarted","Data":"02797444e9dc537c6e5dc8e1a5a5b092644baa5d0569596101f7bc0e818a41bc"}
Sep 10 15:16:30.623213 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:30.623189    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-bh676" event={"ID":"2b6778d4-2e09-485a-af8f-8e4fe72225f3","Type":"ContainerStarted","Data":"fddee78853c00f99d70000273776d0f45f864276332edc411f0499640003b3b7"}
Sep 10 15:16:30.624386 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:30.624364    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-bmscf" event={"ID":"067ecc26-dbf0-48ce-b6e3-ef6ea52dd929","Type":"ContainerStarted","Data":"ddf47bd839c2b01a585872cae13ab4c284f2e26b1f02a405745d1fa40384726e"}
Sep 10 15:16:30.625497 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:30.625467    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27" event={"ID":"c2daa35c-0530-448c-82d6-51be02389e4b","Type":"ContainerStarted","Data":"17a35571b30e3852bd5bd4b925df7c8c7619ac68ff79705ef540e6343e97bfdf"}
Sep 10 15:16:30.626563 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:30.626543    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-jkz86" event={"ID":"2840c3d6-bd89-4b8e-a96a-1cafd9b570a6","Type":"ContainerStarted","Data":"4e507b6524177d5322fbf5b3a6f8b468ef19a7fa09c49df6a578f88d783c7526"}
Sep 10 15:16:30.627581 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:30.627556    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-hl6dl" event={"ID":"24c1b5a4-af41-477d-b635-5a9f877aa79e","Type":"ContainerStarted","Data":"1d0bd496dc76f8cbbfb721b111f56b0ea557f143ea13287ef6d5180fdeb53ca4"}
Sep 10 15:16:31.124827 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:31.124687    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5ec88fb-a404-41af-948d-7991ce803a9a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-twc8q\" (UID: \"d5ec88fb-a404-41af-948d-7991ce803a9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twc8q"
Sep 10 15:16:31.125042 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:31.124875    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 15:16:31.125042 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:31.124979    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5ec88fb-a404-41af-948d-7991ce803a9a-samples-operator-tls podName:d5ec88fb-a404-41af-948d-7991ce803a9a nodeName:}" failed. No retries permitted until 2026-09-10 15:16:33.124950795 +0000 UTC m=+46.174749287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5ec88fb-a404-41af-948d-7991ce803a9a-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-twc8q" (UID: "d5ec88fb-a404-41af-948d-7991ce803a9a") : secret "samples-operator-tls" not found
Sep 10 15:16:31.226549 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:31.226514    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:31.226780 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:31.226760    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 15:16:31.226851 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:31.226787    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bc4569df6-ktjn7: secret "image-registry-tls" not found
Sep 10 15:16:31.226908 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:31.226868    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls podName:39bc4eb0-3627-4a43-9fab-6831317f06e9 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:33.226835833 +0000 UTC m=+46.276634337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls") pod "image-registry-6bc4569df6-ktjn7" (UID: "39bc4eb0-3627-4a43-9fab-6831317f06e9") : secret "image-registry-tls" not found
Sep 10 15:16:31.327565 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:31.327524    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/46fdc592-4de9-4212-8a71-e84cb6d48862-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-pshjh\" (UID: \"46fdc592-4de9-4212-8a71-e84cb6d48862\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh"
Sep 10 15:16:31.327903 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:31.327819    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-metrics-certs\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:31.328038 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:31.327690    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 15:16:31.328099 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:31.328080    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fdc592-4de9-4212-8a71-e84cb6d48862-cluster-monitoring-operator-tls podName:46fdc592-4de9-4212-8a71-e84cb6d48862 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:33.32805849 +0000 UTC m=+46.377857003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/46fdc592-4de9-4212-8a71-e84cb6d48862-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-pshjh" (UID: "46fdc592-4de9-4212-8a71-e84cb6d48862") : secret "cluster-monitoring-operator-tls" not found
Sep 10 15:16:31.328579 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:31.328550    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-service-ca-bundle\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:31.328793 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:31.328777    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-service-ca-bundle podName:d8b23ffc-2066-4cfe-a963-7d4b004ec8b8 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:33.328762278 +0000 UTC m=+46.378560778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-service-ca-bundle") pod "router-default-d685f7754-28m8s" (UID: "d8b23ffc-2066-4cfe-a963-7d4b004ec8b8") : configmap references non-existent config key: service-ca.crt
Sep 10 15:16:31.328903 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:31.328889    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 15:16:31.328985 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:31.328959    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-metrics-certs podName:d8b23ffc-2066-4cfe-a963-7d4b004ec8b8 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:33.328944192 +0000 UTC m=+46.378742696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-metrics-certs") pod "router-default-d685f7754-28m8s" (UID: "d8b23ffc-2066-4cfe-a963-7d4b004ec8b8") : secret "router-metrics-certs-default" not found
Sep 10 15:16:33.146306 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:33.146225    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5ec88fb-a404-41af-948d-7991ce803a9a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-twc8q\" (UID: \"d5ec88fb-a404-41af-948d-7991ce803a9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twc8q"
Sep 10 15:16:33.146738 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:33.146420    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 15:16:33.146738 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:33.146505    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5ec88fb-a404-41af-948d-7991ce803a9a-samples-operator-tls podName:d5ec88fb-a404-41af-948d-7991ce803a9a nodeName:}" failed. No retries permitted until 2026-09-10 15:16:37.146482288 +0000 UTC m=+50.196280788 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5ec88fb-a404-41af-948d-7991ce803a9a-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-twc8q" (UID: "d5ec88fb-a404-41af-948d-7991ce803a9a") : secret "samples-operator-tls" not found
Sep 10 15:16:33.247990 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:33.247906    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:33.248184 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:33.248087    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 15:16:33.248184 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:33.248109    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bc4569df6-ktjn7: secret "image-registry-tls" not found
Sep 10 15:16:33.248184 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:33.248183    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls podName:39bc4eb0-3627-4a43-9fab-6831317f06e9 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:37.248160742 +0000 UTC m=+50.297959231 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls") pod "image-registry-6bc4569df6-ktjn7" (UID: "39bc4eb0-3627-4a43-9fab-6831317f06e9") : secret "image-registry-tls" not found
Sep 10 15:16:33.349386 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:33.349337    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-metrics-certs\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:33.349577 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:33.349452    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-service-ca-bundle\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:33.349577 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:33.349509    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/46fdc592-4de9-4212-8a71-e84cb6d48862-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-pshjh\" (UID: \"46fdc592-4de9-4212-8a71-e84cb6d48862\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh"
Sep 10 15:16:33.349577 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:33.349517    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 15:16:33.349719 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:33.349586    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-metrics-certs podName:d8b23ffc-2066-4cfe-a963-7d4b004ec8b8 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:37.349568375 +0000 UTC m=+50.399366879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-metrics-certs") pod "router-default-d685f7754-28m8s" (UID: "d8b23ffc-2066-4cfe-a963-7d4b004ec8b8") : secret "router-metrics-certs-default" not found
Sep 10 15:16:33.349719 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:33.349630    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-service-ca-bundle podName:d8b23ffc-2066-4cfe-a963-7d4b004ec8b8 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:37.349613177 +0000 UTC m=+50.399411681 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-service-ca-bundle") pod "router-default-d685f7754-28m8s" (UID: "d8b23ffc-2066-4cfe-a963-7d4b004ec8b8") : configmap references non-existent config key: service-ca.crt
Sep 10 15:16:33.349719 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:33.349682    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 15:16:33.349866 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:33.349732    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fdc592-4de9-4212-8a71-e84cb6d48862-cluster-monitoring-operator-tls podName:46fdc592-4de9-4212-8a71-e84cb6d48862 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:37.349719259 +0000 UTC m=+50.399517773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/46fdc592-4de9-4212-8a71-e84cb6d48862-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-pshjh" (UID: "46fdc592-4de9-4212-8a71-e84cb6d48862") : secret "cluster-monitoring-operator-tls" not found
Sep 10 15:16:36.679847 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:36.679818    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f467c0b7-a81b-441e-b76f-288d7ade6d46-metrics-tls\") pod \"dns-default-ppwfd\" (UID: \"f467c0b7-a81b-441e-b76f-288d7ade6d46\") " pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:16:36.680337 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:36.679961    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 15:16:36.680500 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:36.680483    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f467c0b7-a81b-441e-b76f-288d7ade6d46-metrics-tls podName:f467c0b7-a81b-441e-b76f-288d7ade6d46 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:52.68044946 +0000 UTC m=+65.730247963 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f467c0b7-a81b-441e-b76f-288d7ade6d46-metrics-tls") pod "dns-default-ppwfd" (UID: "f467c0b7-a81b-441e-b76f-288d7ade6d46") : secret "dns-default-metrics-tls" not found
Sep 10 15:16:37.184970 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:37.184903    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5ec88fb-a404-41af-948d-7991ce803a9a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-twc8q\" (UID: \"d5ec88fb-a404-41af-948d-7991ce803a9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twc8q"
Sep 10 15:16:37.185157 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:37.185081    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 15:16:37.185238 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:37.185170    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5ec88fb-a404-41af-948d-7991ce803a9a-samples-operator-tls podName:d5ec88fb-a404-41af-948d-7991ce803a9a nodeName:}" failed. No retries permitted until 2026-09-10 15:16:45.185148333 +0000 UTC m=+58.234946833 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5ec88fb-a404-41af-948d-7991ce803a9a-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-twc8q" (UID: "d5ec88fb-a404-41af-948d-7991ce803a9a") : secret "samples-operator-tls" not found
Sep 10 15:16:37.286088 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:37.286033    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:37.286311 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:37.286217    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 15:16:37.286311 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:37.286239    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bc4569df6-ktjn7: secret "image-registry-tls" not found
Sep 10 15:16:37.286311 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:37.286312    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls podName:39bc4eb0-3627-4a43-9fab-6831317f06e9 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:45.286290451 +0000 UTC m=+58.336088943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls") pod "image-registry-6bc4569df6-ktjn7" (UID: "39bc4eb0-3627-4a43-9fab-6831317f06e9") : secret "image-registry-tls" not found
Sep 10 15:16:37.386595 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:37.386551    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-metrics-certs\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:37.386778 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:37.386648    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-service-ca-bundle\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:37.386778 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:37.386696    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/46fdc592-4de9-4212-8a71-e84cb6d48862-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-pshjh\" (UID: \"46fdc592-4de9-4212-8a71-e84cb6d48862\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh"
Sep 10 15:16:37.386778 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:37.386718    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 15:16:37.386947 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:37.386789    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-metrics-certs podName:d8b23ffc-2066-4cfe-a963-7d4b004ec8b8 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:45.386769212 +0000 UTC m=+58.436567719 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-metrics-certs") pod "router-default-d685f7754-28m8s" (UID: "d8b23ffc-2066-4cfe-a963-7d4b004ec8b8") : secret "router-metrics-certs-default" not found
Sep 10 15:16:37.386947 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:37.386808    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-service-ca-bundle podName:d8b23ffc-2066-4cfe-a963-7d4b004ec8b8 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:45.386798446 +0000 UTC m=+58.436596935 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-service-ca-bundle") pod "router-default-d685f7754-28m8s" (UID: "d8b23ffc-2066-4cfe-a963-7d4b004ec8b8") : configmap references non-existent config key: service-ca.crt
Sep 10 15:16:37.386947 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:37.386854    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 15:16:37.386947 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:37.386905    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fdc592-4de9-4212-8a71-e84cb6d48862-cluster-monitoring-operator-tls podName:46fdc592-4de9-4212-8a71-e84cb6d48862 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:45.386889729 +0000 UTC m=+58.436688221 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/46fdc592-4de9-4212-8a71-e84cb6d48862-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-pshjh" (UID: "46fdc592-4de9-4212-8a71-e84cb6d48862") : secret "cluster-monitoring-operator-tls" not found
Sep 10 15:16:37.652167 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:37.652128    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27" event={"ID":"c2daa35c-0530-448c-82d6-51be02389e4b","Type":"ContainerStarted","Data":"cf896236eb0c5dc2a22ab19688b48eaea84d825770fd558f68655ade0ce7af92"}
Sep 10 15:16:37.653772 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:37.653743    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-jkz86" event={"ID":"2840c3d6-bd89-4b8e-a96a-1cafd9b570a6","Type":"ContainerStarted","Data":"9a530fd00a31bd49e661c548c46e8207ea0b55174a4297101fbf1b9008d4fc12"}
Sep 10 15:16:37.655317 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:37.655293    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-hl6dl" event={"ID":"24c1b5a4-af41-477d-b635-5a9f877aa79e","Type":"ContainerStarted","Data":"11a2f4c3e9db6781e3d13294286759d1e49a7e033c9d3a820c5d079b9f517e48"}
Sep 10 15:16:37.657961 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:37.657923    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pvdcp" event={"ID":"75b30207-2908-4328-bc6c-0b2b0bf59df0","Type":"ContainerStarted","Data":"8bc87e04e722a0b39daae31deff87b2d077d20c4f9fcaf9066d8a1f1a6b821d1"}
Sep 10 15:16:37.659851 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:37.659830    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/0.log"
Sep 10 15:16:37.659992 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:37.659876    2574 generic.go:356] "Generic (PLEG): container finished" podID="2b6778d4-2e09-485a-af8f-8e4fe72225f3" containerID="11b5c51b53f8904e955d6883138445c8bcbed70df5cc1f1ee2fa7c298e1372c4" exitCode=255
Sep 10 15:16:37.659992 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:37.659970    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-bh676" event={"ID":"2b6778d4-2e09-485a-af8f-8e4fe72225f3","Type":"ContainerDied","Data":"11b5c51b53f8904e955d6883138445c8bcbed70df5cc1f1ee2fa7c298e1372c4"}
Sep 10 15:16:37.660494 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:37.660354    2574 scope.go:117] "RemoveContainer" containerID="11b5c51b53f8904e955d6883138445c8bcbed70df5cc1f1ee2fa7c298e1372c4"
Sep 10 15:16:37.661512 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:37.661489    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-bmscf" event={"ID":"067ecc26-dbf0-48ce-b6e3-ef6ea52dd929","Type":"ContainerStarted","Data":"991c3c9990804584258cbe9e33f7c19c08ed3f375b66844b4a35eb4278b0f99a"}
Sep 10 15:16:37.671084 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:37.671039    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27" podStartSLOduration=2.264489076 podStartE2EDuration="8.671021224s" totalImagesPullingTime="6.406532148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:16:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:16:37.669774592 +0000 UTC m=+50.719573101" watchObservedRunningTime="2026-09-10 15:16:37.671021224 +0000 UTC m=+50.720819732"
Sep 10 15:16:37.730566 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:37.730503    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-bmscf" podStartSLOduration=2.149892182 podStartE2EDuration="8.730464997s" totalImagesPullingTime="6.580572815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:16:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:16:37.709836848 +0000 UTC m=+50.759635359" watchObservedRunningTime="2026-09-10 15:16:37.730464997 +0000 UTC m=+50.780263508"
Sep 10 15:16:37.731171 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:37.731115    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-hl6dl" podStartSLOduration=2.16424037 podStartE2EDuration="8.731099036s" totalImagesPullingTime="6.566858666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:16:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:16:37.728993057 +0000 UTC m=+50.778791563" watchObservedRunningTime="2026-09-10 15:16:37.731099036 +0000 UTC m=+50.780897541"
Sep 10 15:16:37.751881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:37.751825    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-jkz86" podStartSLOduration=2.234172907 podStartE2EDuration="8.751803642s" totalImagesPullingTime="6.517630735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:16:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:16:37.751119551 +0000 UTC m=+50.800918060" watchObservedRunningTime="2026-09-10 15:16:37.751803642 +0000 UTC m=+50.801602156"
Sep 10 15:16:37.767554 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:37.767288    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pvdcp" podStartSLOduration=2.465056861 podStartE2EDuration="8.767265903s" totalImagesPullingTime="6.302209042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:16:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:16:37.766843165 +0000 UTC m=+50.816641681" watchObservedRunningTime="2026-09-10 15:16:37.767265903 +0000 UTC m=+50.817064414"
Sep 10 15:16:38.312603 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.312565    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-c2sj5"]
Sep 10 15:16:38.322457 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.322427    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:38.326114 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.326037    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 15:16:38.326277 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.326220    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 15:16:38.329547 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.329506    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c2sj5"]
Sep 10 15:16:38.329705 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.329677    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-696sd\""
Sep 10 15:16:38.398584 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.398547    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d79323d6-7b38-4e55-b8c8-12cdd2a27298-data-volume\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:38.398765 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.398640    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d79323d6-7b38-4e55-b8c8-12cdd2a27298-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:38.398765 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.398692    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ndzv\" (UniqueName: \"kubernetes.io/projected/d79323d6-7b38-4e55-b8c8-12cdd2a27298-kube-api-access-4ndzv\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:38.398885 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.398859    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d79323d6-7b38-4e55-b8c8-12cdd2a27298-crio-socket\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:38.398960 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.398906    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d79323d6-7b38-4e55-b8c8-12cdd2a27298-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:38.499852 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.499811    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d79323d6-7b38-4e55-b8c8-12cdd2a27298-data-volume\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:38.500043 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.499878    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d79323d6-7b38-4e55-b8c8-12cdd2a27298-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:38.500043 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.499921    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ndzv\" (UniqueName: \"kubernetes.io/projected/d79323d6-7b38-4e55-b8c8-12cdd2a27298-kube-api-access-4ndzv\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:38.500043 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:38.500019    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 15:16:38.500171 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:38.500090    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d79323d6-7b38-4e55-b8c8-12cdd2a27298-kube-rbac-proxy-cm podName:d79323d6-7b38-4e55-b8c8-12cdd2a27298 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:39.00007027 +0000 UTC m=+52.049868774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d79323d6-7b38-4e55-b8c8-12cdd2a27298-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c2sj5" (UID: "d79323d6-7b38-4e55-b8c8-12cdd2a27298") : configmap "kube-rbac-proxy" not found
Sep 10 15:16:38.500283 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.500198    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d79323d6-7b38-4e55-b8c8-12cdd2a27298-crio-socket\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:38.500283 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.500226    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d79323d6-7b38-4e55-b8c8-12cdd2a27298-data-volume\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:38.500283 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.500231    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d79323d6-7b38-4e55-b8c8-12cdd2a27298-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:38.500466 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:38.500296    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 15:16:38.500466 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.500316    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d79323d6-7b38-4e55-b8c8-12cdd2a27298-crio-socket\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:38.500466 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:38.500335    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d79323d6-7b38-4e55-b8c8-12cdd2a27298-insights-runtime-extractor-tls podName:d79323d6-7b38-4e55-b8c8-12cdd2a27298 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:39.000319958 +0000 UTC m=+52.050118445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d79323d6-7b38-4e55-b8c8-12cdd2a27298-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c2sj5" (UID: "d79323d6-7b38-4e55-b8c8-12cdd2a27298") : secret "insights-runtime-extractor-tls" not found
Sep 10 15:16:38.509103 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.509073    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ndzv\" (UniqueName: \"kubernetes.io/projected/d79323d6-7b38-4e55-b8c8-12cdd2a27298-kube-api-access-4ndzv\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:38.666886 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.666814    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/1.log"
Sep 10 15:16:38.667307 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.667290    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/0.log"
Sep 10 15:16:38.667379 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.667323    2574 generic.go:356] "Generic (PLEG): container finished" podID="2b6778d4-2e09-485a-af8f-8e4fe72225f3" containerID="fdd71e871f40fd5c69cd413e443579c4105e258df62d4d70184dfcff5ddfbe8b" exitCode=255
Sep 10 15:16:38.667430 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.667400    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-bh676" event={"ID":"2b6778d4-2e09-485a-af8f-8e4fe72225f3","Type":"ContainerDied","Data":"fdd71e871f40fd5c69cd413e443579c4105e258df62d4d70184dfcff5ddfbe8b"}
Sep 10 15:16:38.667480 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.667440    2574 scope.go:117] "RemoveContainer" containerID="11b5c51b53f8904e955d6883138445c8bcbed70df5cc1f1ee2fa7c298e1372c4"
Sep 10 15:16:38.667719 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:38.667696    2574 scope.go:117] "RemoveContainer" containerID="fdd71e871f40fd5c69cd413e443579c4105e258df62d4d70184dfcff5ddfbe8b"
Sep 10 15:16:38.667908 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:38.667883    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-bh676_openshift-console-operator(2b6778d4-2e09-485a-af8f-8e4fe72225f3)\"" pod="openshift-console-operator/console-operator-85b454874b-bh676" podUID="2b6778d4-2e09-485a-af8f-8e4fe72225f3"
Sep 10 15:16:39.005276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:39.005189    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d79323d6-7b38-4e55-b8c8-12cdd2a27298-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:39.005725 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:39.005288    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d79323d6-7b38-4e55-b8c8-12cdd2a27298-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:39.005725 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:39.005357    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 15:16:39.005725 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:39.005406    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 15:16:39.005725 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:39.005448    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d79323d6-7b38-4e55-b8c8-12cdd2a27298-insights-runtime-extractor-tls podName:d79323d6-7b38-4e55-b8c8-12cdd2a27298 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:40.005424077 +0000 UTC m=+53.055222580 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d79323d6-7b38-4e55-b8c8-12cdd2a27298-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c2sj5" (UID: "d79323d6-7b38-4e55-b8c8-12cdd2a27298") : secret "insights-runtime-extractor-tls" not found
Sep 10 15:16:39.005725 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:39.005467    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d79323d6-7b38-4e55-b8c8-12cdd2a27298-kube-rbac-proxy-cm podName:d79323d6-7b38-4e55-b8c8-12cdd2a27298 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:40.005455144 +0000 UTC m=+53.055253631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d79323d6-7b38-4e55-b8c8-12cdd2a27298-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c2sj5" (UID: "d79323d6-7b38-4e55-b8c8-12cdd2a27298") : configmap "kube-rbac-proxy" not found
Sep 10 15:16:39.671814 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:39.671786    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/1.log"
Sep 10 15:16:39.672185 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:39.672167    2574 scope.go:117] "RemoveContainer" containerID="fdd71e871f40fd5c69cd413e443579c4105e258df62d4d70184dfcff5ddfbe8b"
Sep 10 15:16:39.672373 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:39.672353    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-bh676_openshift-console-operator(2b6778d4-2e09-485a-af8f-8e4fe72225f3)\"" pod="openshift-console-operator/console-operator-85b454874b-bh676" podUID="2b6778d4-2e09-485a-af8f-8e4fe72225f3"
Sep 10 15:16:39.840598 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:39.840555    2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-bh676"
Sep 10 15:16:39.840743 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:39.840631    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-bh676"
Sep 10 15:16:40.014167 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:40.014071    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d79323d6-7b38-4e55-b8c8-12cdd2a27298-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:40.014560 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:40.014179    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d79323d6-7b38-4e55-b8c8-12cdd2a27298-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:40.014560 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:40.014251    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 15:16:40.014560 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:40.014323    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d79323d6-7b38-4e55-b8c8-12cdd2a27298-insights-runtime-extractor-tls podName:d79323d6-7b38-4e55-b8c8-12cdd2a27298 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:42.01430461 +0000 UTC m=+55.064103103 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d79323d6-7b38-4e55-b8c8-12cdd2a27298-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c2sj5" (UID: "d79323d6-7b38-4e55-b8c8-12cdd2a27298") : secret "insights-runtime-extractor-tls" not found
Sep 10 15:16:40.014560 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:40.014325    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 15:16:40.014560 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:40.014392    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d79323d6-7b38-4e55-b8c8-12cdd2a27298-kube-rbac-proxy-cm podName:d79323d6-7b38-4e55-b8c8-12cdd2a27298 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:42.01437328 +0000 UTC m=+55.064171781 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d79323d6-7b38-4e55-b8c8-12cdd2a27298-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c2sj5" (UID: "d79323d6-7b38-4e55-b8c8-12cdd2a27298") : configmap "kube-rbac-proxy" not found
Sep 10 15:16:40.047194 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:40.047167    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bj7vg_4ba47f2c-aa01-49e8-8b3a-2534c01624a4/dns-node-resolver/0.log"
Sep 10 15:16:40.679515 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:40.679484    2574 scope.go:117] "RemoveContainer" containerID="fdd71e871f40fd5c69cd413e443579c4105e258df62d4d70184dfcff5ddfbe8b"
Sep 10 15:16:40.679676 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:40.679637    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-bh676_openshift-console-operator(2b6778d4-2e09-485a-af8f-8e4fe72225f3)\"" pod="openshift-console-operator/console-operator-85b454874b-bh676" podUID="2b6778d4-2e09-485a-af8f-8e4fe72225f3"
Sep 10 15:16:41.246821 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:41.246791    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9ctw2_a7ffe6a3-b6d6-4481-b023-95ad5eae05fc/node-ca/0.log"
Sep 10 15:16:42.032271 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:42.032232    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d79323d6-7b38-4e55-b8c8-12cdd2a27298-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:42.032464 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:42.032388    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d79323d6-7b38-4e55-b8c8-12cdd2a27298-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:42.032464 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:42.032390    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 15:16:42.032464 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:42.032456    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d79323d6-7b38-4e55-b8c8-12cdd2a27298-insights-runtime-extractor-tls podName:d79323d6-7b38-4e55-b8c8-12cdd2a27298 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:46.032438522 +0000 UTC m=+59.082237014 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d79323d6-7b38-4e55-b8c8-12cdd2a27298-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c2sj5" (UID: "d79323d6-7b38-4e55-b8c8-12cdd2a27298") : secret "insights-runtime-extractor-tls" not found
Sep 10 15:16:42.032575 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:42.032475    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 15:16:42.032575 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:42.032518    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d79323d6-7b38-4e55-b8c8-12cdd2a27298-kube-rbac-proxy-cm podName:d79323d6-7b38-4e55-b8c8-12cdd2a27298 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:46.032506135 +0000 UTC m=+59.082304645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d79323d6-7b38-4e55-b8c8-12cdd2a27298-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c2sj5" (UID: "d79323d6-7b38-4e55-b8c8-12cdd2a27298") : configmap "kube-rbac-proxy" not found
Sep 10 15:16:42.047479 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:42.047448    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xlrmn_88a69307-bfe3-4f8a-b5c3-f9387e0d66f0/serve-healthcheck-canary/0.log"
Sep 10 15:16:45.258150 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:45.258104    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5ec88fb-a404-41af-948d-7991ce803a9a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-twc8q\" (UID: \"d5ec88fb-a404-41af-948d-7991ce803a9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twc8q"
Sep 10 15:16:45.258567 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:45.258270    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 15:16:45.258567 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:45.258347    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5ec88fb-a404-41af-948d-7991ce803a9a-samples-operator-tls podName:d5ec88fb-a404-41af-948d-7991ce803a9a nodeName:}" failed. No retries permitted until 2026-09-10 15:17:01.258329262 +0000 UTC m=+74.308127749 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5ec88fb-a404-41af-948d-7991ce803a9a-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-twc8q" (UID: "d5ec88fb-a404-41af-948d-7991ce803a9a") : secret "samples-operator-tls" not found
Sep 10 15:16:45.359459 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:45.359420    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:16:45.359650 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:45.359597    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 15:16:45.359650 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:45.359619    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bc4569df6-ktjn7: secret "image-registry-tls" not found
Sep 10 15:16:45.359781 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:45.359701    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls podName:39bc4eb0-3627-4a43-9fab-6831317f06e9 nodeName:}" failed. No retries permitted until 2026-09-10 15:17:01.359678728 +0000 UTC m=+74.409477234 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls") pod "image-registry-6bc4569df6-ktjn7" (UID: "39bc4eb0-3627-4a43-9fab-6831317f06e9") : secret "image-registry-tls" not found
Sep 10 15:16:45.460386 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:45.460347    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/46fdc592-4de9-4212-8a71-e84cb6d48862-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-pshjh\" (UID: \"46fdc592-4de9-4212-8a71-e84cb6d48862\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh"
Sep 10 15:16:45.460580 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:45.460454    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-metrics-certs\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:45.460580 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:45.460508    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-service-ca-bundle\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:16:45.460580 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:45.460544    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 15:16:45.460710 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:45.460579    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 15:16:45.460710 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:45.460610    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-service-ca-bundle podName:d8b23ffc-2066-4cfe-a963-7d4b004ec8b8 nodeName:}" failed. No retries permitted until 2026-09-10 15:17:01.460596945 +0000 UTC m=+74.510395431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-service-ca-bundle") pod "router-default-d685f7754-28m8s" (UID: "d8b23ffc-2066-4cfe-a963-7d4b004ec8b8") : configmap references non-existent config key: service-ca.crt
Sep 10 15:16:45.460710 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:45.460626    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-metrics-certs podName:d8b23ffc-2066-4cfe-a963-7d4b004ec8b8 nodeName:}" failed. No retries permitted until 2026-09-10 15:17:01.460618979 +0000 UTC m=+74.510417465 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-metrics-certs") pod "router-default-d685f7754-28m8s" (UID: "d8b23ffc-2066-4cfe-a963-7d4b004ec8b8") : secret "router-metrics-certs-default" not found
Sep 10 15:16:45.460710 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:45.460635    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fdc592-4de9-4212-8a71-e84cb6d48862-cluster-monitoring-operator-tls podName:46fdc592-4de9-4212-8a71-e84cb6d48862 nodeName:}" failed. No retries permitted until 2026-09-10 15:17:01.460630391 +0000 UTC m=+74.510428877 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/46fdc592-4de9-4212-8a71-e84cb6d48862-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-pshjh" (UID: "46fdc592-4de9-4212-8a71-e84cb6d48862") : secret "cluster-monitoring-operator-tls" not found
Sep 10 15:16:45.583664 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:45.583631    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd4sl"
Sep 10 15:16:46.066304 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:46.066269    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d79323d6-7b38-4e55-b8c8-12cdd2a27298-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:46.066470 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:46.066396    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 15:16:46.066470 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:46.066413    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d79323d6-7b38-4e55-b8c8-12cdd2a27298-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:46.066549 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:46.066507    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d79323d6-7b38-4e55-b8c8-12cdd2a27298-kube-rbac-proxy-cm podName:d79323d6-7b38-4e55-b8c8-12cdd2a27298 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:54.066486526 +0000 UTC m=+67.116285077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d79323d6-7b38-4e55-b8c8-12cdd2a27298-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c2sj5" (UID: "d79323d6-7b38-4e55-b8c8-12cdd2a27298") : configmap "kube-rbac-proxy" not found
Sep 10 15:16:46.066590 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:46.066569    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 15:16:46.066996 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:46.066975    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d79323d6-7b38-4e55-b8c8-12cdd2a27298-insights-runtime-extractor-tls podName:d79323d6-7b38-4e55-b8c8-12cdd2a27298 nodeName:}" failed. No retries permitted until 2026-09-10 15:16:54.066949207 +0000 UTC m=+67.116747708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d79323d6-7b38-4e55-b8c8-12cdd2a27298-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c2sj5" (UID: "d79323d6-7b38-4e55-b8c8-12cdd2a27298") : secret "insights-runtime-extractor-tls" not found
Sep 10 15:16:52.726190 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:52.726150    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f467c0b7-a81b-441e-b76f-288d7ade6d46-metrics-tls\") pod \"dns-default-ppwfd\" (UID: \"f467c0b7-a81b-441e-b76f-288d7ade6d46\") " pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:16:52.728499 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:52.728475    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f467c0b7-a81b-441e-b76f-288d7ade6d46-metrics-tls\") pod \"dns-default-ppwfd\" (UID: \"f467c0b7-a81b-441e-b76f-288d7ade6d46\") " pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:16:52.907501 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:52.907470    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4q2px\""
Sep 10 15:16:52.914922 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:52.914902    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:16:53.217084 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.217059    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ppwfd"]
Sep 10 15:16:53.219502 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:16:53.219474    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf467c0b7_a81b_441e_b76f_288d7ade6d46.slice/crio-85290af936f4b3e20a56e746d26d599acee2f1f59ffa2fc288b68211f09d6dda WatchSource:0}: Error finding container 85290af936f4b3e20a56e746d26d599acee2f1f59ffa2fc288b68211f09d6dda: Status 404 returned error can't find the container with id 85290af936f4b3e20a56e746d26d599acee2f1f59ffa2fc288b68211f09d6dda
Sep 10 15:16:53.231616 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.231590    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcgwn\" (UniqueName: \"kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn\") pod \"network-check-target-jfhkb\" (UID: \"17387da0-5265-4e58-9383-ccc3e8cbf5ea\") " pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:16:53.231720 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.231631    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs\") pod \"network-metrics-daemon-s87zw\" (UID: \"dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc\") " pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:16:53.231720 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.231705    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret\") pod \"global-pull-secret-syncer-9qzxr\" (UID: \"8bd848e3-5919-4d0a-80c9-f2bd7f7db58b\") " pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:16:53.234159 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.234136    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcgwn\" (UniqueName: \"kubernetes.io/projected/17387da0-5265-4e58-9383-ccc3e8cbf5ea-kube-api-access-qcgwn\") pod \"network-check-target-jfhkb\" (UID: \"17387da0-5265-4e58-9383-ccc3e8cbf5ea\") " pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:16:53.234455 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.234438    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 15:16:53.234583 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.234567    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 15:16:53.242858 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:53.242805    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 10 15:16:53.242958 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:53.242865    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs podName:dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc nodeName:}" failed. No retries permitted until 2026-09-10 15:17:57.242849485 +0000 UTC m=+130.292647971 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs") pod "network-metrics-daemon-s87zw" (UID: "dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc") : secret "metrics-daemon-secret" not found
Sep 10 15:16:53.245237 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.245217    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bd848e3-5919-4d0a-80c9-f2bd7f7db58b-original-pull-secret\") pod \"global-pull-secret-syncer-9qzxr\" (UID: \"8bd848e3-5919-4d0a-80c9-f2bd7f7db58b\") " pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:16:53.314330 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.314292    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qzxr"
Sep 10 15:16:53.408155 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.408132    2574 scope.go:117] "RemoveContainer" containerID="fdd71e871f40fd5c69cd413e443579c4105e258df62d4d70184dfcff5ddfbe8b"
Sep 10 15:16:53.527482 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.527397    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-96bxt\""
Sep 10 15:16:53.534976 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.534949    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:16:53.608217 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.608184    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9qzxr"]
Sep 10 15:16:53.611978 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:16:53.611951    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bd848e3_5919_4d0a_80c9_f2bd7f7db58b.slice/crio-62a6b1c292669d5f20f8ae429c39990503e3d248fee5fb5d6c9200041048fcf1 WatchSource:0}: Error finding container 62a6b1c292669d5f20f8ae429c39990503e3d248fee5fb5d6c9200041048fcf1: Status 404 returned error can't find the container with id 62a6b1c292669d5f20f8ae429c39990503e3d248fee5fb5d6c9200041048fcf1
Sep 10 15:16:53.718627 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.718599    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/2.log"
Sep 10 15:16:53.719282 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.719262    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/1.log"
Sep 10 15:16:53.719399 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.719305    2574 generic.go:356] "Generic (PLEG): container finished" podID="2b6778d4-2e09-485a-af8f-8e4fe72225f3" containerID="ac48d794f66a825968241e59072d77df1c2dc6efe3570c79d9a80d84ed3f5e4a" exitCode=255
Sep 10 15:16:53.719456 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.719391    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-bh676" event={"ID":"2b6778d4-2e09-485a-af8f-8e4fe72225f3","Type":"ContainerDied","Data":"ac48d794f66a825968241e59072d77df1c2dc6efe3570c79d9a80d84ed3f5e4a"}
Sep 10 15:16:53.719510 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.719453    2574 scope.go:117] "RemoveContainer" containerID="fdd71e871f40fd5c69cd413e443579c4105e258df62d4d70184dfcff5ddfbe8b"
Sep 10 15:16:53.719836 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.719808    2574 scope.go:117] "RemoveContainer" containerID="ac48d794f66a825968241e59072d77df1c2dc6efe3570c79d9a80d84ed3f5e4a"
Sep 10 15:16:53.720059 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:53.720033    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-bh676_openshift-console-operator(2b6778d4-2e09-485a-af8f-8e4fe72225f3)\"" pod="openshift-console-operator/console-operator-85b454874b-bh676" podUID="2b6778d4-2e09-485a-af8f-8e4fe72225f3"
Sep 10 15:16:53.720973 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.720921    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9qzxr" event={"ID":"8bd848e3-5919-4d0a-80c9-f2bd7f7db58b","Type":"ContainerStarted","Data":"62a6b1c292669d5f20f8ae429c39990503e3d248fee5fb5d6c9200041048fcf1"}
Sep 10 15:16:53.722324 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.722301    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ppwfd" event={"ID":"f467c0b7-a81b-441e-b76f-288d7ade6d46","Type":"ContainerStarted","Data":"85290af936f4b3e20a56e746d26d599acee2f1f59ffa2fc288b68211f09d6dda"}
Sep 10 15:16:53.838643 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:53.838480    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jfhkb"]
Sep 10 15:16:53.841292 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:16:53.841263    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17387da0_5265_4e58_9383_ccc3e8cbf5ea.slice/crio-f24444da1836c0dbb825410f2b364de47c7e815aa0f56ef571dc413d512b5cd7 WatchSource:0}: Error finding container f24444da1836c0dbb825410f2b364de47c7e815aa0f56ef571dc413d512b5cd7: Status 404 returned error can't find the container with id f24444da1836c0dbb825410f2b364de47c7e815aa0f56ef571dc413d512b5cd7
Sep 10 15:16:54.141666 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:54.141583    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d79323d6-7b38-4e55-b8c8-12cdd2a27298-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:54.141819 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:54.141679    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d79323d6-7b38-4e55-b8c8-12cdd2a27298-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:54.141819 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:54.141685    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 15:16:54.141958 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:54.141860    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d79323d6-7b38-4e55-b8c8-12cdd2a27298-insights-runtime-extractor-tls podName:d79323d6-7b38-4e55-b8c8-12cdd2a27298 nodeName:}" failed. No retries permitted until 2026-09-10 15:17:10.14184071 +0000 UTC m=+83.191639217 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d79323d6-7b38-4e55-b8c8-12cdd2a27298-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c2sj5" (UID: "d79323d6-7b38-4e55-b8c8-12cdd2a27298") : secret "insights-runtime-extractor-tls" not found
Sep 10 15:16:54.142323 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:54.142292    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d79323d6-7b38-4e55-b8c8-12cdd2a27298-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:16:54.731062 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:54.731024    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jfhkb" event={"ID":"17387da0-5265-4e58-9383-ccc3e8cbf5ea","Type":"ContainerStarted","Data":"fae8c34807cccb96c62c220fe59397b297c9c78846ff363d43630bb36e080e19"}
Sep 10 15:16:54.731247 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:54.731087    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jfhkb" event={"ID":"17387da0-5265-4e58-9383-ccc3e8cbf5ea","Type":"ContainerStarted","Data":"f24444da1836c0dbb825410f2b364de47c7e815aa0f56ef571dc413d512b5cd7"}
Sep 10 15:16:54.731472 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:54.731407    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:16:54.734217 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:54.734180    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/2.log"
Sep 10 15:16:54.750539 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:54.750480    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jfhkb" podStartSLOduration=67.750457401 podStartE2EDuration="1m7.750457401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:15:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:16:54.749347084 +0000 UTC m=+67.799145604" watchObservedRunningTime="2026-09-10 15:16:54.750457401 +0000 UTC m=+67.800255911"
Sep 10 15:16:55.739546 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:55.739504    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ppwfd" event={"ID":"f467c0b7-a81b-441e-b76f-288d7ade6d46","Type":"ContainerStarted","Data":"08bf6ee5a4d14ec03628b91a6dd7a64e7f5f16685a144d7aebe449da5d2e724f"}
Sep 10 15:16:55.740044 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:55.739574    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ppwfd" event={"ID":"f467c0b7-a81b-441e-b76f-288d7ade6d46","Type":"ContainerStarted","Data":"fbe7f9983daac61f3b26c8dae6943d98fb4dc43ac8edc5f5a26a532074f38113"}
Sep 10 15:16:55.760587 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:55.760538    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ppwfd" podStartSLOduration=34.149706592 podStartE2EDuration="35.760519214s" totalImagesPullingTime="1.610812622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:16:55.759176763 +0000 UTC m=+68.808975275" watchObservedRunningTime="2026-09-10 15:16:55.760519214 +0000 UTC m=+68.810317724"
Sep 10 15:16:56.742717 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:56.742674    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:16:57.747077 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:57.747041    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9qzxr" event={"ID":"8bd848e3-5919-4d0a-80c9-f2bd7f7db58b","Type":"ContainerStarted","Data":"078aaaa9a28ece58644cb62cf0ccbeff41d25f8364f5c9faa01c08304756331c"}
Sep 10 15:16:59.841359 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:59.841315    2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-bh676"
Sep 10 15:16:59.841750 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:59.841379    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-bh676"
Sep 10 15:16:59.841750 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:59.841715    2574 scope.go:117] "RemoveContainer" containerID="ac48d794f66a825968241e59072d77df1c2dc6efe3570c79d9a80d84ed3f5e4a"
Sep 10 15:16:59.841899 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:16:59.841878    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-bh676_openshift-console-operator(2b6778d4-2e09-485a-af8f-8e4fe72225f3)\"" pod="openshift-console-operator/console-operator-85b454874b-bh676" podUID="2b6778d4-2e09-485a-af8f-8e4fe72225f3"
Sep 10 15:16:59.860430 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:16:59.860380    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9qzxr" podStartSLOduration=68.959290092 podStartE2EDuration="1m12.860364869s" totalImagesPullingTime="3.901074777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:16:57.763803108 +0000 UTC m=+70.813601616" watchObservedRunningTime="2026-09-10 15:16:59.860364869 +0000 UTC m=+72.910163374"
Sep 10 15:17:01.305901 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:01.305862    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5ec88fb-a404-41af-948d-7991ce803a9a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-twc8q\" (UID: \"d5ec88fb-a404-41af-948d-7991ce803a9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twc8q"
Sep 10 15:17:01.308214 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:01.308193    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5ec88fb-a404-41af-948d-7991ce803a9a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-twc8q\" (UID: \"d5ec88fb-a404-41af-948d-7991ce803a9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twc8q"
Sep 10 15:17:01.406199 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:01.406169    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:17:01.408504 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:01.408477    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls\") pod \"image-registry-6bc4569df6-ktjn7\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") " pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:17:01.462012 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:01.461984    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nr574\""
Sep 10 15:17:01.468532 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:01.468511    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twc8q"
Sep 10 15:17:01.507598 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:01.507564    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/46fdc592-4de9-4212-8a71-e84cb6d48862-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-pshjh\" (UID: \"46fdc592-4de9-4212-8a71-e84cb6d48862\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh"
Sep 10 15:17:01.507777 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:01.507636    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-metrics-certs\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:17:01.507777 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:01.507663    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-service-ca-bundle\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:17:01.508242 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:01.508217    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-service-ca-bundle\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:17:01.509886 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:01.509856    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b23ffc-2066-4cfe-a963-7d4b004ec8b8-metrics-certs\") pod \"router-default-d685f7754-28m8s\" (UID: \"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8\") " pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:17:01.509998 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:01.509908    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/46fdc592-4de9-4212-8a71-e84cb6d48862-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-pshjh\" (UID: \"46fdc592-4de9-4212-8a71-e84cb6d48862\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh"
Sep 10 15:17:01.551051 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:01.551024    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sxzrd\""
Sep 10 15:17:01.556982 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:01.556917    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:17:01.656833 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:01.656806    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lsqpr\""
Sep 10 15:17:01.661870 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:01.661856    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh"
Sep 10 15:17:01.721714 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:01.721689    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4tw6r\""
Sep 10 15:17:01.728506 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:01.728480    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:17:01.751351 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:01.751328    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twc8q"]
Sep 10 15:17:01.832464 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:01.832394    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bc4569df6-ktjn7"]
Sep 10 15:17:01.834839 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:17:01.834812    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39bc4eb0_3627_4a43_9fab_6831317f06e9.slice/crio-d1d84215f6e86232136b3564bff159e2391985309380a5e4750b5f4ca0bf6b84 WatchSource:0}: Error finding container d1d84215f6e86232136b3564bff159e2391985309380a5e4750b5f4ca0bf6b84: Status 404 returned error can't find the container with id d1d84215f6e86232136b3564bff159e2391985309380a5e4750b5f4ca0bf6b84
Sep 10 15:17:01.929839 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:01.929808    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh"]
Sep 10 15:17:01.932703 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:17:01.932673    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46fdc592_4de9_4212_8a71_e84cb6d48862.slice/crio-f03309424eddf546f441414ca6d26785f20e440dda9189286dc34ea99033bb50 WatchSource:0}: Error finding container f03309424eddf546f441414ca6d26785f20e440dda9189286dc34ea99033bb50: Status 404 returned error can't find the container with id f03309424eddf546f441414ca6d26785f20e440dda9189286dc34ea99033bb50
Sep 10 15:17:02.003428 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:02.003385    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-d685f7754-28m8s"]
Sep 10 15:17:02.006545 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:17:02.006520    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b23ffc_2066_4cfe_a963_7d4b004ec8b8.slice/crio-d59281563c7bf1c812c309eac5132fb269f9648ee3b1ffeea99dc49ec1266ba0 WatchSource:0}: Error finding container d59281563c7bf1c812c309eac5132fb269f9648ee3b1ffeea99dc49ec1266ba0: Status 404 returned error can't find the container with id d59281563c7bf1c812c309eac5132fb269f9648ee3b1ffeea99dc49ec1266ba0
Sep 10 15:17:02.764985 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:02.764903    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7" event={"ID":"39bc4eb0-3627-4a43-9fab-6831317f06e9","Type":"ContainerStarted","Data":"fb599833be058ee2d99f944b37c8e6fd17f909c94e11fa06d1c7c0082ae1c876"}
Sep 10 15:17:02.764985 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:02.764986    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7" event={"ID":"39bc4eb0-3627-4a43-9fab-6831317f06e9","Type":"ContainerStarted","Data":"d1d84215f6e86232136b3564bff159e2391985309380a5e4750b5f4ca0bf6b84"}
Sep 10 15:17:02.765621 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:02.765575    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:17:02.767807 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:02.767775    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-d685f7754-28m8s" event={"ID":"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8","Type":"ContainerStarted","Data":"ba0114f35ce5db4d09aa59bbd85c6cae88eff1b2293c34350fecdcedc4cde9c5"}
Sep 10 15:17:02.767957 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:02.767823    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-d685f7754-28m8s" event={"ID":"d8b23ffc-2066-4cfe-a963-7d4b004ec8b8","Type":"ContainerStarted","Data":"d59281563c7bf1c812c309eac5132fb269f9648ee3b1ffeea99dc49ec1266ba0"}
Sep 10 15:17:02.769796 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:02.769764    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh" event={"ID":"46fdc592-4de9-4212-8a71-e84cb6d48862","Type":"ContainerStarted","Data":"f03309424eddf546f441414ca6d26785f20e440dda9189286dc34ea99033bb50"}
Sep 10 15:17:02.771229 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:02.771202    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twc8q" event={"ID":"d5ec88fb-a404-41af-948d-7991ce803a9a","Type":"ContainerStarted","Data":"e655a2f3d6ae9e2dedf13cb4f2882a2358a4da4e7f3a4b485cf85ea442553a72"}
Sep 10 15:17:02.788835 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:02.788787    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7" podStartSLOduration=33.788771539 podStartE2EDuration="33.788771539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:16:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:17:02.78719123 +0000 UTC m=+75.836989730" watchObservedRunningTime="2026-09-10 15:17:02.788771539 +0000 UTC m=+75.838570049"
Sep 10 15:17:02.807642 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:02.807591    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-d685f7754-28m8s" podStartSLOduration=33.807572228 podStartE2EDuration="33.807572228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:16:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:17:02.805699674 +0000 UTC m=+75.855498182" watchObservedRunningTime="2026-09-10 15:17:02.807572228 +0000 UTC m=+75.857370736"
Sep 10 15:17:03.729097 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:03.729062    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:17:03.732845 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:03.732820    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:17:03.759340 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:03.759306    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bc4569df6-ktjn7"]
Sep 10 15:17:03.774910 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:03.774867    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:17:03.776138 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:03.776114    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-d685f7754-28m8s"
Sep 10 15:17:04.780221 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:04.780186    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh" event={"ID":"46fdc592-4de9-4212-8a71-e84cb6d48862","Type":"ContainerStarted","Data":"93677646786fba1812e44dc48dd1c444eff1d23fe68ebc207cbd138d01a39017"}
Sep 10 15:17:04.782151 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:04.782128    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twc8q" event={"ID":"d5ec88fb-a404-41af-948d-7991ce803a9a","Type":"ContainerStarted","Data":"4985f9a99cbdc8c4f48895c9c8cdc6e95fb744f86af92a3c9698dfd19a5bd53d"}
Sep 10 15:17:04.782240 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:04.782174    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twc8q" event={"ID":"d5ec88fb-a404-41af-948d-7991ce803a9a","Type":"ContainerStarted","Data":"83b74482eee28dbc37959998fbfa50aa460d23f5be21f5ab68da1eb3b14154c9"}
Sep 10 15:17:04.797132 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:04.797071    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-pshjh" podStartSLOduration=33.497155692 podStartE2EDuration="35.797048687s" totalImagesPullingTime="2.299892995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:16:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:17:04.795273814 +0000 UTC m=+77.845072341" watchObservedRunningTime="2026-09-10 15:17:04.797048687 +0000 UTC m=+77.846847197"
Sep 10 15:17:04.831790 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:04.831735    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twc8q" podStartSLOduration=33.385456879 podStartE2EDuration="35.831717209s" totalImagesPullingTime="2.44626033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:16:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:17:04.830955257 +0000 UTC m=+77.880753768" watchObservedRunningTime="2026-09-10 15:17:04.831717209 +0000 UTC m=+77.881515714"
Sep 10 15:17:06.748723 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:06.748691    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ppwfd"
Sep 10 15:17:09.824962 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:09.824824    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-vvj2g"]
Sep 10 15:17:09.840510 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:09.840480    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-vvj2g"]
Sep 10 15:17:09.840677 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:09.840609    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-vvj2g"
Sep 10 15:17:09.843573 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:09.843539    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 10 15:17:09.843729 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:09.843539    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 10 15:17:09.844652 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:09.844630    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-qzp98\""
Sep 10 15:17:09.844764 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:09.844628    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 15:17:09.981660 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:09.981623    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a1f2df5-5319-4911-b274-7df9b4f726a5-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-vvj2g\" (UID: \"6a1f2df5-5319-4911-b274-7df9b4f726a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vvj2g"
Sep 10 15:17:09.981660 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:09.981667    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a1f2df5-5319-4911-b274-7df9b4f726a5-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-vvj2g\" (UID: \"6a1f2df5-5319-4911-b274-7df9b4f726a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vvj2g"
Sep 10 15:17:09.981910 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:09.981760    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a1f2df5-5319-4911-b274-7df9b4f726a5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-vvj2g\" (UID: \"6a1f2df5-5319-4911-b274-7df9b4f726a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vvj2g"
Sep 10 15:17:09.981910 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:09.981807    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntzm6\" (UniqueName: \"kubernetes.io/projected/6a1f2df5-5319-4911-b274-7df9b4f726a5-kube-api-access-ntzm6\") pod \"prometheus-operator-6f4946db56-vvj2g\" (UID: \"6a1f2df5-5319-4911-b274-7df9b4f726a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vvj2g"
Sep 10 15:17:10.082680 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:10.082589    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a1f2df5-5319-4911-b274-7df9b4f726a5-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-vvj2g\" (UID: \"6a1f2df5-5319-4911-b274-7df9b4f726a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vvj2g"
Sep 10 15:17:10.082680 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:10.082644    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a1f2df5-5319-4911-b274-7df9b4f726a5-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-vvj2g\" (UID: \"6a1f2df5-5319-4911-b274-7df9b4f726a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vvj2g"
Sep 10 15:17:10.082880 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:10.082698    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a1f2df5-5319-4911-b274-7df9b4f726a5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-vvj2g\" (UID: \"6a1f2df5-5319-4911-b274-7df9b4f726a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vvj2g"
Sep 10 15:17:10.082880 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:10.082733    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntzm6\" (UniqueName: \"kubernetes.io/projected/6a1f2df5-5319-4911-b274-7df9b4f726a5-kube-api-access-ntzm6\") pod \"prometheus-operator-6f4946db56-vvj2g\" (UID: \"6a1f2df5-5319-4911-b274-7df9b4f726a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vvj2g"
Sep 10 15:17:10.083317 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:10.083289    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a1f2df5-5319-4911-b274-7df9b4f726a5-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-vvj2g\" (UID: \"6a1f2df5-5319-4911-b274-7df9b4f726a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vvj2g"
Sep 10 15:17:10.085112 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:10.085090    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a1f2df5-5319-4911-b274-7df9b4f726a5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-vvj2g\" (UID: \"6a1f2df5-5319-4911-b274-7df9b4f726a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vvj2g"
Sep 10 15:17:10.085209 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:10.085162    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a1f2df5-5319-4911-b274-7df9b4f726a5-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-vvj2g\" (UID: \"6a1f2df5-5319-4911-b274-7df9b4f726a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vvj2g"
Sep 10 15:17:10.092150 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:10.092109    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntzm6\" (UniqueName: \"kubernetes.io/projected/6a1f2df5-5319-4911-b274-7df9b4f726a5-kube-api-access-ntzm6\") pod \"prometheus-operator-6f4946db56-vvj2g\" (UID: \"6a1f2df5-5319-4911-b274-7df9b4f726a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vvj2g"
Sep 10 15:17:10.150364 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:10.150324    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-vvj2g"
Sep 10 15:17:10.183769 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:10.183743    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d79323d6-7b38-4e55-b8c8-12cdd2a27298-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:17:10.186311 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:10.186283    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d79323d6-7b38-4e55-b8c8-12cdd2a27298-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2sj5\" (UID: \"d79323d6-7b38-4e55-b8c8-12cdd2a27298\") " pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:17:10.439172 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:10.439098    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-vvj2g"]
Sep 10 15:17:10.440666 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:10.440647    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-696sd\""
Sep 10 15:17:10.442277 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:17:10.442255    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a1f2df5_5319_4911_b274_7df9b4f726a5.slice/crio-dd7c29484ca704a302e077da2a588370f284f5404ae7a38440de05a8053af4f2 WatchSource:0}: Error finding container dd7c29484ca704a302e077da2a588370f284f5404ae7a38440de05a8053af4f2: Status 404 returned error can't find the container with id dd7c29484ca704a302e077da2a588370f284f5404ae7a38440de05a8053af4f2
Sep 10 15:17:10.448813 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:10.448794    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c2sj5"
Sep 10 15:17:10.716296 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:10.716220    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c2sj5"]
Sep 10 15:17:10.719230 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:17:10.719204    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd79323d6_7b38_4e55_b8c8_12cdd2a27298.slice/crio-98610e3e3303c76e0a9d975fc2c6e3103b25d2de0f9c0e8ca933e1e1681b8204 WatchSource:0}: Error finding container 98610e3e3303c76e0a9d975fc2c6e3103b25d2de0f9c0e8ca933e1e1681b8204: Status 404 returned error can't find the container with id 98610e3e3303c76e0a9d975fc2c6e3103b25d2de0f9c0e8ca933e1e1681b8204
Sep 10 15:17:10.803801 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:10.803763    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c2sj5" event={"ID":"d79323d6-7b38-4e55-b8c8-12cdd2a27298","Type":"ContainerStarted","Data":"f3d6561a2b09110dfb049d2b3eafdd3c85412821246ac9c35b809fb248ad6ef0"}
Sep 10 15:17:10.803990 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:10.803865    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c2sj5" event={"ID":"d79323d6-7b38-4e55-b8c8-12cdd2a27298","Type":"ContainerStarted","Data":"98610e3e3303c76e0a9d975fc2c6e3103b25d2de0f9c0e8ca933e1e1681b8204"}
Sep 10 15:17:10.805081 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:10.805057    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-vvj2g" event={"ID":"6a1f2df5-5319-4911-b274-7df9b4f726a5","Type":"ContainerStarted","Data":"dd7c29484ca704a302e077da2a588370f284f5404ae7a38440de05a8053af4f2"}
Sep 10 15:17:12.816667 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:12.816555    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-vvj2g" event={"ID":"6a1f2df5-5319-4911-b274-7df9b4f726a5","Type":"ContainerStarted","Data":"f4fbd6efaa20a08ed17e8e22d655186a0c8e2a8d817c8ea41ba6f977ab290b30"}
Sep 10 15:17:12.816667 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:12.816630    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-vvj2g" event={"ID":"6a1f2df5-5319-4911-b274-7df9b4f726a5","Type":"ContainerStarted","Data":"08c137b9ca125765cf892b18279d4b53c1e7bd1d728362a8d589e2e8e4df9684"}
Sep 10 15:17:12.818991 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:12.818950    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c2sj5" event={"ID":"d79323d6-7b38-4e55-b8c8-12cdd2a27298","Type":"ContainerStarted","Data":"e96cda8f5257c61dbadaf960e390f02ab35fd7013bf3bf9d5de70cdcfdcd37ae"}
Sep 10 15:17:12.837086 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:12.837038    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-vvj2g" podStartSLOduration=2.37380999 podStartE2EDuration="3.837019794s" totalImagesPullingTime="1.463209804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:17:12.834979408 +0000 UTC m=+85.884777916" watchObservedRunningTime="2026-09-10 15:17:12.837019794 +0000 UTC m=+85.886818303"
Sep 10 15:17:13.403614 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:13.403595    2574 scope.go:117] "RemoveContainer" containerID="ac48d794f66a825968241e59072d77df1c2dc6efe3570c79d9a80d84ed3f5e4a"
Sep 10 15:17:13.403767 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:17:13.403747    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-bh676_openshift-console-operator(2b6778d4-2e09-485a-af8f-8e4fe72225f3)\"" pod="openshift-console-operator/console-operator-85b454874b-bh676" podUID="2b6778d4-2e09-485a-af8f-8e4fe72225f3"
Sep 10 15:17:13.824491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:13.824451    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c2sj5" event={"ID":"d79323d6-7b38-4e55-b8c8-12cdd2a27298","Type":"ContainerStarted","Data":"3f0dbab7b8e60c16daad9850873040c0c5d42b68c5f165caa3d31cd2cacd3e62"}
Sep 10 15:17:13.844939 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:13.844890    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-c2sj5" podStartSLOduration=33.355295267 podStartE2EDuration="35.844874484s" totalImagesPullingTime="2.489579217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:16:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:17:13.84311982 +0000 UTC m=+86.892918328" watchObservedRunningTime="2026-09-10 15:17:13.844874484 +0000 UTC m=+86.894672992"
Sep 10 15:17:15.211478 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.211438    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x8m5f"]
Sep 10 15:17:15.215751 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.215723    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.218562 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.218544    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 15:17:15.218660 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.218568    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 15:17:15.218660 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.218588    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 15:17:15.218738 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.218683    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m2csv\""
Sep 10 15:17:15.237338 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.237310    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-node-exporter-tls\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.237501 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.237349    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-node-exporter-wtmp\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.237501 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.237376    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.237501 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.237399    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-node-exporter-accelerators-collector-config\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.237501 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.237428    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-sys\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.237501 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.237453    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-root\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.237667 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.237531    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-node-exporter-textfile\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.237667 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.237566    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-metrics-client-ca\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.237667 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.237598    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4tnc\" (UniqueName: \"kubernetes.io/projected/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-kube-api-access-x4tnc\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.338502 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.338463    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-node-exporter-tls\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.338502 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.338505    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-node-exporter-wtmp\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.338754 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.338534    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.338754 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.338558    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-node-exporter-accelerators-collector-config\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.338754 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.338589    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-sys\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.338754 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.338612    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-root\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.338754 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.338652    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-node-exporter-wtmp\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.338754 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.338671    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-sys\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.338754 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.338667    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-node-exporter-textfile\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.339097 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.338753    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-root\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.339097 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.338805    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-metrics-client-ca\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.339097 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.338854    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4tnc\" (UniqueName: \"kubernetes.io/projected/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-kube-api-access-x4tnc\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.339097 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.339057    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-node-exporter-textfile\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.339388 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.339366    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-node-exporter-accelerators-collector-config\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.339444 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.339423    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-metrics-client-ca\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.340875 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.340857    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-node-exporter-tls\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.340994 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.340910    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.347771 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.347749    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4tnc\" (UniqueName: \"kubernetes.io/projected/aeba31b7-92df-410f-b2ea-e2a2b39cb89c-kube-api-access-x4tnc\") pod \"node-exporter-x8m5f\" (UID: \"aeba31b7-92df-410f-b2ea-e2a2b39cb89c\") " pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.525190 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.525094    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x8m5f"
Sep 10 15:17:15.535869 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:17:15.535840    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeba31b7_92df_410f_b2ea_e2a2b39cb89c.slice/crio-b03052ae23f186abab52dccb523790417bd0eeb7eaca35ccee94a04654164937 WatchSource:0}: Error finding container b03052ae23f186abab52dccb523790417bd0eeb7eaca35ccee94a04654164937: Status 404 returned error can't find the container with id b03052ae23f186abab52dccb523790417bd0eeb7eaca35ccee94a04654164937
Sep 10 15:17:15.832517 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:15.832483    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x8m5f" event={"ID":"aeba31b7-92df-410f-b2ea-e2a2b39cb89c","Type":"ContainerStarted","Data":"b03052ae23f186abab52dccb523790417bd0eeb7eaca35ccee94a04654164937"}
Sep 10 15:17:16.838649 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:16.838551    2574 generic.go:356] "Generic (PLEG): container finished" podID="aeba31b7-92df-410f-b2ea-e2a2b39cb89c" containerID="f2416d4c3235f4b7bfd16406224ac1c6fe1463736e50bda86e486acf573a7727" exitCode=0
Sep 10 15:17:16.838649 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:16.838593    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x8m5f" event={"ID":"aeba31b7-92df-410f-b2ea-e2a2b39cb89c","Type":"ContainerDied","Data":"f2416d4c3235f4b7bfd16406224ac1c6fe1463736e50bda86e486acf573a7727"}
Sep 10 15:17:17.844280 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:17.844244    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x8m5f" event={"ID":"aeba31b7-92df-410f-b2ea-e2a2b39cb89c","Type":"ContainerStarted","Data":"f157fc260b40d4be7ee654a31e07c89a24660b07de75d4cdfb2045de5a917228"}
Sep 10 15:17:17.844688 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:17.844307    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x8m5f" event={"ID":"aeba31b7-92df-410f-b2ea-e2a2b39cb89c","Type":"ContainerStarted","Data":"932f7954597706272f4bd47221a06e683bc2dbd404166137a5892acd794cf58a"}
Sep 10 15:17:17.868364 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:17.868316    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x8m5f" podStartSLOduration=1.762180699 podStartE2EDuration="2.868301446s" totalImagesPullingTime="1.043543871s" totalInitContainerRuntime="62.576876ms" isStatefulPod=true podCreationTimestamp="2026-09-10 15:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:17:17.867062944 +0000 UTC m=+90.916861452" watchObservedRunningTime="2026-09-10 15:17:17.868301446 +0000 UTC m=+90.918099954"
Sep 10 15:17:24.788384 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:24.788354    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:17:25.403439 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:25.403405    2574 scope.go:117] "RemoveContainer" containerID="ac48d794f66a825968241e59072d77df1c2dc6efe3570c79d9a80d84ed3f5e4a"
Sep 10 15:17:25.742594 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:25.742506    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jfhkb"
Sep 10 15:17:25.881480 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:25.881454    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/2.log"
Sep 10 15:17:25.881858 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:25.881536    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-bh676" event={"ID":"2b6778d4-2e09-485a-af8f-8e4fe72225f3","Type":"ContainerStarted","Data":"700ad6ad209b673b90064fc43ea538bb8349fcf4c4dccce668106caeea0b5eb4"}
Sep 10 15:17:25.881950 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:25.881878    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-bh676"
Sep 10 15:17:25.901278 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:25.901221    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-bh676" podStartSLOduration=50.468728766 podStartE2EDuration="56.901201357s" totalImagesPullingTime="6.432472591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:16:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:17:25.899717221 +0000 UTC m=+98.949515729" watchObservedRunningTime="2026-09-10 15:17:25.901201357 +0000 UTC m=+98.950999866"
Sep 10 15:17:26.882072 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:26.882018    2574 patch_prober.go:28] interesting pod/console-operator-85b454874b-bh676 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.133.0.13:8443/readyz\": context deadline exceeded" start-of-body=
Sep 10 15:17:26.882518 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:26.882098    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-85b454874b-bh676" podUID="2b6778d4-2e09-485a-af8f-8e4fe72225f3" containerName="console-operator" probeResult="failure" output="Get \"https://10.133.0.13:8443/readyz\": context deadline exceeded"
Sep 10 15:17:27.094956 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:27.094904    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-bh676"
Sep 10 15:17:27.268850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:27.268777    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-jwxcq"]
Sep 10 15:17:27.275887 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:27.275863    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-jwxcq"
Sep 10 15:17:27.278532 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:27.278509    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lmz56\""
Sep 10 15:17:27.278646 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:27.278557    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 15:17:27.278708 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:27.278651    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 15:17:27.280484 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:27.280458    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-jwxcq"]
Sep 10 15:17:27.348676 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:27.348640    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd894\" (UniqueName: \"kubernetes.io/projected/ddb1ead0-f944-4234-95d3-a7d19ff1578a-kube-api-access-dd894\") pod \"downloads-85d98c998f-jwxcq\" (UID: \"ddb1ead0-f944-4234-95d3-a7d19ff1578a\") " pod="openshift-console/downloads-85d98c998f-jwxcq"
Sep 10 15:17:27.449860 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:27.449818    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd894\" (UniqueName: \"kubernetes.io/projected/ddb1ead0-f944-4234-95d3-a7d19ff1578a-kube-api-access-dd894\") pod \"downloads-85d98c998f-jwxcq\" (UID: \"ddb1ead0-f944-4234-95d3-a7d19ff1578a\") " pod="openshift-console/downloads-85d98c998f-jwxcq"
Sep 10 15:17:27.459291 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:27.459259    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd894\" (UniqueName: \"kubernetes.io/projected/ddb1ead0-f944-4234-95d3-a7d19ff1578a-kube-api-access-dd894\") pod \"downloads-85d98c998f-jwxcq\" (UID: \"ddb1ead0-f944-4234-95d3-a7d19ff1578a\") " pod="openshift-console/downloads-85d98c998f-jwxcq"
Sep 10 15:17:27.585992 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:27.585957    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-jwxcq"
Sep 10 15:17:27.857694 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:27.857618    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-jwxcq"]
Sep 10 15:17:27.861573 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:17:27.861547    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddb1ead0_f944_4234_95d3_a7d19ff1578a.slice/crio-716e3df00de020dcd3fc30efce1f832bfc6704f3de4a30271da1fd3e93684e04 WatchSource:0}: Error finding container 716e3df00de020dcd3fc30efce1f832bfc6704f3de4a30271da1fd3e93684e04: Status 404 returned error can't find the container with id 716e3df00de020dcd3fc30efce1f832bfc6704f3de4a30271da1fd3e93684e04
Sep 10 15:17:27.890842 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:27.890805    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-jwxcq" event={"ID":"ddb1ead0-f944-4234-95d3-a7d19ff1578a","Type":"ContainerStarted","Data":"716e3df00de020dcd3fc30efce1f832bfc6704f3de4a30271da1fd3e93684e04"}
Sep 10 15:17:29.801844 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:29.801790    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7" podUID="39bc4eb0-3627-4a43-9fab-6831317f06e9" containerName="registry" containerID="cri-o://fb599833be058ee2d99f944b37c8e6fd17f909c94e11fa06d1c7c0082ae1c876" gracePeriod=30
Sep 10 15:17:30.058035 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.057968    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:17:30.175760 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.175712    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls\") pod \"39bc4eb0-3627-4a43-9fab-6831317f06e9\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") "
Sep 10 15:17:30.175964 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.175788    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgzv2\" (UniqueName: \"kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-kube-api-access-lgzv2\") pod \"39bc4eb0-3627-4a43-9fab-6831317f06e9\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") "
Sep 10 15:17:30.175964 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.175821    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-certificates\") pod \"39bc4eb0-3627-4a43-9fab-6831317f06e9\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") "
Sep 10 15:17:30.175964 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.175889    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/39bc4eb0-3627-4a43-9fab-6831317f06e9-installation-pull-secrets\") pod \"39bc4eb0-3627-4a43-9fab-6831317f06e9\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") "
Sep 10 15:17:30.176157 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.176005    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/39bc4eb0-3627-4a43-9fab-6831317f06e9-ca-trust-extracted\") pod \"39bc4eb0-3627-4a43-9fab-6831317f06e9\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") "
Sep 10 15:17:30.176157 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.176067    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39bc4eb0-3627-4a43-9fab-6831317f06e9-trusted-ca\") pod \"39bc4eb0-3627-4a43-9fab-6831317f06e9\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") "
Sep 10 15:17:30.176157 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.176113    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-bound-sa-token\") pod \"39bc4eb0-3627-4a43-9fab-6831317f06e9\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") "
Sep 10 15:17:30.176157 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.176148    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/39bc4eb0-3627-4a43-9fab-6831317f06e9-image-registry-private-configuration\") pod \"39bc4eb0-3627-4a43-9fab-6831317f06e9\" (UID: \"39bc4eb0-3627-4a43-9fab-6831317f06e9\") "
Sep 10 15:17:30.176635 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.176462    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "39bc4eb0-3627-4a43-9fab-6831317f06e9" (UID: "39bc4eb0-3627-4a43-9fab-6831317f06e9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:17:30.177178 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.177148    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39bc4eb0-3627-4a43-9fab-6831317f06e9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "39bc4eb0-3627-4a43-9fab-6831317f06e9" (UID: "39bc4eb0-3627-4a43-9fab-6831317f06e9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:17:30.181038 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.180873    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "39bc4eb0-3627-4a43-9fab-6831317f06e9" (UID: "39bc4eb0-3627-4a43-9fab-6831317f06e9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:17:30.181645 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.181617    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39bc4eb0-3627-4a43-9fab-6831317f06e9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "39bc4eb0-3627-4a43-9fab-6831317f06e9" (UID: "39bc4eb0-3627-4a43-9fab-6831317f06e9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:17:30.182031 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.181991    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-kube-api-access-lgzv2" (OuterVolumeSpecName: "kube-api-access-lgzv2") pod "39bc4eb0-3627-4a43-9fab-6831317f06e9" (UID: "39bc4eb0-3627-4a43-9fab-6831317f06e9"). InnerVolumeSpecName "kube-api-access-lgzv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:17:30.182298 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.182254    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "39bc4eb0-3627-4a43-9fab-6831317f06e9" (UID: "39bc4eb0-3627-4a43-9fab-6831317f06e9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:17:30.182536 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.182509    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39bc4eb0-3627-4a43-9fab-6831317f06e9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "39bc4eb0-3627-4a43-9fab-6831317f06e9" (UID: "39bc4eb0-3627-4a43-9fab-6831317f06e9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:17:30.199789 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.199745    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39bc4eb0-3627-4a43-9fab-6831317f06e9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "39bc4eb0-3627-4a43-9fab-6831317f06e9" (UID: "39bc4eb0-3627-4a43-9fab-6831317f06e9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:17:30.276823 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.276787    2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/39bc4eb0-3627-4a43-9fab-6831317f06e9-installation-pull-secrets\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:17:30.276823 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.276823    2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/39bc4eb0-3627-4a43-9fab-6831317f06e9-ca-trust-extracted\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:17:30.277085 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.276838    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39bc4eb0-3627-4a43-9fab-6831317f06e9-trusted-ca\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:17:30.277085 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.276851    2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-bound-sa-token\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:17:30.277085 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.276866    2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/39bc4eb0-3627-4a43-9fab-6831317f06e9-image-registry-private-configuration\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:17:30.277085 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.276880    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-tls\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:17:30.277085 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.276893    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgzv2\" (UniqueName: \"kubernetes.io/projected/39bc4eb0-3627-4a43-9fab-6831317f06e9-kube-api-access-lgzv2\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:17:30.277085 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.276906    2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/39bc4eb0-3627-4a43-9fab-6831317f06e9-registry-certificates\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:17:30.906408 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.906366    2574 generic.go:356] "Generic (PLEG): container finished" podID="39bc4eb0-3627-4a43-9fab-6831317f06e9" containerID="fb599833be058ee2d99f944b37c8e6fd17f909c94e11fa06d1c7c0082ae1c876" exitCode=0
Sep 10 15:17:30.906841 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.906428    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7"
Sep 10 15:17:30.906841 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.906437    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7" event={"ID":"39bc4eb0-3627-4a43-9fab-6831317f06e9","Type":"ContainerDied","Data":"fb599833be058ee2d99f944b37c8e6fd17f909c94e11fa06d1c7c0082ae1c876"}
Sep 10 15:17:30.906841 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.906481    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bc4569df6-ktjn7" event={"ID":"39bc4eb0-3627-4a43-9fab-6831317f06e9","Type":"ContainerDied","Data":"d1d84215f6e86232136b3564bff159e2391985309380a5e4750b5f4ca0bf6b84"}
Sep 10 15:17:30.906841 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.906509    2574 scope.go:117] "RemoveContainer" containerID="fb599833be058ee2d99f944b37c8e6fd17f909c94e11fa06d1c7c0082ae1c876"
Sep 10 15:17:30.915791 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.915765    2574 scope.go:117] "RemoveContainer" containerID="fb599833be058ee2d99f944b37c8e6fd17f909c94e11fa06d1c7c0082ae1c876"
Sep 10 15:17:30.916216 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:17:30.916189    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb599833be058ee2d99f944b37c8e6fd17f909c94e11fa06d1c7c0082ae1c876\": container with ID starting with fb599833be058ee2d99f944b37c8e6fd17f909c94e11fa06d1c7c0082ae1c876 not found: ID does not exist" containerID="fb599833be058ee2d99f944b37c8e6fd17f909c94e11fa06d1c7c0082ae1c876"
Sep 10 15:17:30.916322 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.916226    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb599833be058ee2d99f944b37c8e6fd17f909c94e11fa06d1c7c0082ae1c876"} err="failed to get container status \"fb599833be058ee2d99f944b37c8e6fd17f909c94e11fa06d1c7c0082ae1c876\": rpc error: code = NotFound desc = could not find container \"fb599833be058ee2d99f944b37c8e6fd17f909c94e11fa06d1c7c0082ae1c876\": container with ID starting with fb599833be058ee2d99f944b37c8e6fd17f909c94e11fa06d1c7c0082ae1c876 not found: ID does not exist"
Sep 10 15:17:30.933247 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.933220    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bc4569df6-ktjn7"]
Sep 10 15:17:30.937895 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:30.937858    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bc4569df6-ktjn7"]
Sep 10 15:17:31.409818 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:31.409780    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39bc4eb0-3627-4a43-9fab-6831317f06e9" path="/var/lib/kubelet/pods/39bc4eb0-3627-4a43-9fab-6831317f06e9/volumes"
Sep 10 15:17:31.973940 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:31.973895    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66449cb6b7-t9hc9"]
Sep 10 15:17:31.974389 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:31.974281    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39bc4eb0-3627-4a43-9fab-6831317f06e9" containerName="registry"
Sep 10 15:17:31.974389 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:31.974306    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="39bc4eb0-3627-4a43-9fab-6831317f06e9" containerName="registry"
Sep 10 15:17:31.974389 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:31.974366    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="39bc4eb0-3627-4a43-9fab-6831317f06e9" containerName="registry"
Sep 10 15:17:32.015509 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.015474    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66449cb6b7-t9hc9"]
Sep 10 15:17:32.015681 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.015633    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:32.018696 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.018667    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 15:17:32.018836 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.018752    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vfjnd\""
Sep 10 15:17:32.019698 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.019674    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 15:17:32.019807 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.019749    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 15:17:32.019807 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.019776    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 15:17:32.019924 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.019878    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 15:17:32.093280 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.093243    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-console-oauth-config\") pod \"console-66449cb6b7-t9hc9\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") " pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:32.093458 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.093289    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-console-serving-cert\") pod \"console-66449cb6b7-t9hc9\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") " pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:32.093458 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.093365    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-console-config\") pod \"console-66449cb6b7-t9hc9\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") " pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:32.093458 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.093438    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-service-ca\") pod \"console-66449cb6b7-t9hc9\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") " pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:32.093687 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.093468    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-oauth-serving-cert\") pod \"console-66449cb6b7-t9hc9\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") " pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:32.093687 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.093497    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vbqz\" (UniqueName: \"kubernetes.io/projected/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-kube-api-access-9vbqz\") pod \"console-66449cb6b7-t9hc9\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") " pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:32.194620 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.194579    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-console-oauth-config\") pod \"console-66449cb6b7-t9hc9\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") " pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:32.194809 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.194631    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-console-serving-cert\") pod \"console-66449cb6b7-t9hc9\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") " pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:32.194809 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.194778    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-console-config\") pod \"console-66449cb6b7-t9hc9\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") " pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:32.194949 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.194834    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-service-ca\") pod \"console-66449cb6b7-t9hc9\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") " pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:32.194949 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.194867    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-oauth-serving-cert\") pod \"console-66449cb6b7-t9hc9\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") " pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:32.194949 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.194901    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vbqz\" (UniqueName: \"kubernetes.io/projected/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-kube-api-access-9vbqz\") pod \"console-66449cb6b7-t9hc9\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") " pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:32.195679 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.195627    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-console-config\") pod \"console-66449cb6b7-t9hc9\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") " pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:32.195679 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.195669    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-service-ca\") pod \"console-66449cb6b7-t9hc9\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") " pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:32.195968 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.195945    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-oauth-serving-cert\") pod \"console-66449cb6b7-t9hc9\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") " pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:32.197500 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.197479    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-console-serving-cert\") pod \"console-66449cb6b7-t9hc9\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") " pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:32.197588 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.197515    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-console-oauth-config\") pod \"console-66449cb6b7-t9hc9\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") " pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:32.205834 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.205809    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vbqz\" (UniqueName: \"kubernetes.io/projected/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-kube-api-access-9vbqz\") pod \"console-66449cb6b7-t9hc9\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") " pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:32.329415 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.329377    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:32.631791 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.631761    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66449cb6b7-t9hc9"]
Sep 10 15:17:32.634569 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:17:32.634541    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab2b330_dc17_498d_b7b3_1fcbb30aff44.slice/crio-71d89e2d8abf37d9befaa8f6034a5846d7d8145adc9ebfebe943c3ec4555a9f8 WatchSource:0}: Error finding container 71d89e2d8abf37d9befaa8f6034a5846d7d8145adc9ebfebe943c3ec4555a9f8: Status 404 returned error can't find the container with id 71d89e2d8abf37d9befaa8f6034a5846d7d8145adc9ebfebe943c3ec4555a9f8
Sep 10 15:17:32.917860 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:32.917774    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66449cb6b7-t9hc9" event={"ID":"0ab2b330-dc17-498d-b7b3-1fcbb30aff44","Type":"ContainerStarted","Data":"71d89e2d8abf37d9befaa8f6034a5846d7d8145adc9ebfebe943c3ec4555a9f8"}
Sep 10 15:17:36.936613 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:36.936571    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66449cb6b7-t9hc9" event={"ID":"0ab2b330-dc17-498d-b7b3-1fcbb30aff44","Type":"ContainerStarted","Data":"9583c3fcbf254c3f393040987db11bf958952832f29bfe7b4af7013a6ac78cee"}
Sep 10 15:17:36.956155 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:36.956096    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66449cb6b7-t9hc9" podStartSLOduration=2.176136617 podStartE2EDuration="5.956073413s" totalImagesPullingTime="3.779936796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:17:36.955125858 +0000 UTC m=+110.004924369" watchObservedRunningTime="2026-09-10 15:17:36.956073413 +0000 UTC m=+110.005871924"
Sep 10 15:17:41.174167 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.174129    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c94d546bc-4c9bs"]
Sep 10 15:17:41.176685 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.176659    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.185213 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.185186    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 15:17:41.189663 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.189637    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c94d546bc-4c9bs"]
Sep 10 15:17:41.277052 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.277008    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-service-ca\") pod \"console-7c94d546bc-4c9bs\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") " pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.277250 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.277091    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wsfw\" (UniqueName: \"kubernetes.io/projected/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-kube-api-access-9wsfw\") pod \"console-7c94d546bc-4c9bs\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") " pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.277250 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.277192    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-console-config\") pod \"console-7c94d546bc-4c9bs\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") " pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.277250 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.277224    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-oauth-serving-cert\") pod \"console-7c94d546bc-4c9bs\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") " pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.277421 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.277259    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-trusted-ca-bundle\") pod \"console-7c94d546bc-4c9bs\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") " pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.277421 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.277293    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-console-serving-cert\") pod \"console-7c94d546bc-4c9bs\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") " pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.277421 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.277319    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-console-oauth-config\") pod \"console-7c94d546bc-4c9bs\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") " pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.378014 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.377971    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wsfw\" (UniqueName: \"kubernetes.io/projected/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-kube-api-access-9wsfw\") pod \"console-7c94d546bc-4c9bs\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") " pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.378214 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.378083    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-console-config\") pod \"console-7c94d546bc-4c9bs\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") " pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.378280 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.378204    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-oauth-serving-cert\") pod \"console-7c94d546bc-4c9bs\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") " pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.378280 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.378265    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-trusted-ca-bundle\") pod \"console-7c94d546bc-4c9bs\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") " pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.378396 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.378292    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-console-serving-cert\") pod \"console-7c94d546bc-4c9bs\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") " pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.378396 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.378328    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-console-oauth-config\") pod \"console-7c94d546bc-4c9bs\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") " pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.378396 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.378376    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-service-ca\") pod \"console-7c94d546bc-4c9bs\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") " pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.379142 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.379075    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-console-config\") pod \"console-7c94d546bc-4c9bs\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") " pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.379291 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.379178    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-service-ca\") pod \"console-7c94d546bc-4c9bs\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") " pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.379291 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.379192    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-trusted-ca-bundle\") pod \"console-7c94d546bc-4c9bs\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") " pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.379291 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.379260    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-oauth-serving-cert\") pod \"console-7c94d546bc-4c9bs\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") " pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.381189 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.381163    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-console-serving-cert\") pod \"console-7c94d546bc-4c9bs\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") " pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.381324 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.381308    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-console-oauth-config\") pod \"console-7c94d546bc-4c9bs\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") " pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.386766 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.386740    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wsfw\" (UniqueName: \"kubernetes.io/projected/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-kube-api-access-9wsfw\") pod \"console-7c94d546bc-4c9bs\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") " pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:41.488329 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:41.488235    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:42.330372 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:42.330328    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:42.330853 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:42.330461    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:42.336377 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:42.336347    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:42.967236 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:42.967201    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:17:44.972073 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:44.972039    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-jwxcq" event={"ID":"ddb1ead0-f944-4234-95d3-a7d19ff1578a","Type":"ContainerStarted","Data":"7f1989bff873f9c502942cabf94ce6c9c3fefcd55268568b426088a12a5248fb"}
Sep 10 15:17:44.972441 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:44.972352    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-jwxcq"
Sep 10 15:17:44.973731 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:44.973702    2574 patch_prober.go:28] interesting pod/downloads-85d98c998f-jwxcq container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.20:8080/\": dial tcp 10.133.0.20:8080: connect: connection refused" start-of-body=
Sep 10 15:17:44.973845 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:44.973796    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-85d98c998f-jwxcq" podUID="ddb1ead0-f944-4234-95d3-a7d19ff1578a" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.20:8080/\": dial tcp 10.133.0.20:8080: connect: connection refused"
Sep 10 15:17:44.989866 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:44.989793    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c94d546bc-4c9bs"]
Sep 10 15:17:44.992197 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:44.992150    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-jwxcq" podStartSLOduration=1.028306997 podStartE2EDuration="17.992130923s" totalImagesPullingTime="16.963823926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:17:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:17:44.990653966 +0000 UTC m=+118.040452487" watchObservedRunningTime="2026-09-10 15:17:44.992130923 +0000 UTC m=+118.041929432"
Sep 10 15:17:44.993895 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:17:44.993864    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc71a06_8787_44d3_b051_0bf60d2dbf5a.slice/crio-e276fd599a45ecc6c85667877907b513ab0eae621441debca89057cc63abdc17 WatchSource:0}: Error finding container e276fd599a45ecc6c85667877907b513ab0eae621441debca89057cc63abdc17: Status 404 returned error can't find the container with id e276fd599a45ecc6c85667877907b513ab0eae621441debca89057cc63abdc17
Sep 10 15:17:45.979438 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:45.979392    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c94d546bc-4c9bs" event={"ID":"ddc71a06-8787-44d3-b051-0bf60d2dbf5a","Type":"ContainerStarted","Data":"c537386908230d40cf21ace64da6515b4df8ad61d50a2538e880c844ce91d6e8"}
Sep 10 15:17:45.979909 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:45.979464    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c94d546bc-4c9bs" event={"ID":"ddc71a06-8787-44d3-b051-0bf60d2dbf5a","Type":"ContainerStarted","Data":"e276fd599a45ecc6c85667877907b513ab0eae621441debca89057cc63abdc17"}
Sep 10 15:17:45.994653 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:45.994617    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-jwxcq"
Sep 10 15:17:45.999100 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:45.999045    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c94d546bc-4c9bs" podStartSLOduration=4.99902416 podStartE2EDuration="4.99902416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:17:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:17:45.998200059 +0000 UTC m=+119.047998593" watchObservedRunningTime="2026-09-10 15:17:45.99902416 +0000 UTC m=+119.048822670"
Sep 10 15:17:47.990573 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:47.990533    2574 generic.go:356] "Generic (PLEG): container finished" podID="24c1b5a4-af41-477d-b635-5a9f877aa79e" containerID="11a2f4c3e9db6781e3d13294286759d1e49a7e033c9d3a820c5d079b9f517e48" exitCode=0
Sep 10 15:17:47.991080 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:47.990619    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-hl6dl" event={"ID":"24c1b5a4-af41-477d-b635-5a9f877aa79e","Type":"ContainerDied","Data":"11a2f4c3e9db6781e3d13294286759d1e49a7e033c9d3a820c5d079b9f517e48"}
Sep 10 15:17:47.991151 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:47.991082    2574 scope.go:117] "RemoveContainer" containerID="11a2f4c3e9db6781e3d13294286759d1e49a7e033c9d3a820c5d079b9f517e48"
Sep 10 15:17:48.997414 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:48.997378    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-hl6dl" event={"ID":"24c1b5a4-af41-477d-b635-5a9f877aa79e","Type":"ContainerStarted","Data":"c8867c35c64fa7dbc8972ab0d38de383ef8c5693c62761da01678a3a7e51717b"}
Sep 10 15:17:51.489001 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:51.488956    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:51.489465 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:51.489038    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:51.494260 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:51.494229    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:52.015632 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:52.015599    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:17:52.066541 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:52.066509    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66449cb6b7-t9hc9"]
Sep 10 15:17:53.017016 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:53.016925    2574 generic.go:356] "Generic (PLEG): container finished" podID="067ecc26-dbf0-48ce-b6e3-ef6ea52dd929" containerID="991c3c9990804584258cbe9e33f7c19c08ed3f375b66844b4a35eb4278b0f99a" exitCode=0
Sep 10 15:17:53.017016 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:53.016974    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-bmscf" event={"ID":"067ecc26-dbf0-48ce-b6e3-ef6ea52dd929","Type":"ContainerDied","Data":"991c3c9990804584258cbe9e33f7c19c08ed3f375b66844b4a35eb4278b0f99a"}
Sep 10 15:17:53.017586 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:53.017538    2574 scope.go:117] "RemoveContainer" containerID="991c3c9990804584258cbe9e33f7c19c08ed3f375b66844b4a35eb4278b0f99a"
Sep 10 15:17:54.023234 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:54.023196    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-bmscf" event={"ID":"067ecc26-dbf0-48ce-b6e3-ef6ea52dd929","Type":"ContainerStarted","Data":"54d38ca1eaf0047e6bcad80d3592a83a21e20b837e09f387f2147bf8e52f1ca2"}
Sep 10 15:17:57.328919 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:57.328872    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs\") pod \"network-metrics-daemon-s87zw\" (UID: \"dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc\") " pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:17:57.331448 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:57.331410    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc-metrics-certs\") pod \"network-metrics-daemon-s87zw\" (UID: \"dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc\") " pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:17:57.420891 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:57.420859    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d5wmh\""
Sep 10 15:17:57.429176 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:57.429153    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s87zw"
Sep 10 15:17:57.725209 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:57.725181    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s87zw"]
Sep 10 15:17:57.741814 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:17:57.741784    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc21bf10_3b7b_4ad2_b17c_fc5fcae1e2dc.slice/crio-4895100c5572c78e5fae5a5333f1070b0dfc4b03fb15bb19131f5bc002d1b361 WatchSource:0}: Error finding container 4895100c5572c78e5fae5a5333f1070b0dfc4b03fb15bb19131f5bc002d1b361: Status 404 returned error can't find the container with id 4895100c5572c78e5fae5a5333f1070b0dfc4b03fb15bb19131f5bc002d1b361
Sep 10 15:17:58.041256 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:58.041221    2574 generic.go:356] "Generic (PLEG): container finished" podID="c2daa35c-0530-448c-82d6-51be02389e4b" containerID="cf896236eb0c5dc2a22ab19688b48eaea84d825770fd558f68655ade0ce7af92" exitCode=0
Sep 10 15:17:58.041395 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:58.041297    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27" event={"ID":"c2daa35c-0530-448c-82d6-51be02389e4b","Type":"ContainerDied","Data":"cf896236eb0c5dc2a22ab19688b48eaea84d825770fd558f68655ade0ce7af92"}
Sep 10 15:17:58.041700 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:58.041683    2574 scope.go:117] "RemoveContainer" containerID="cf896236eb0c5dc2a22ab19688b48eaea84d825770fd558f68655ade0ce7af92"
Sep 10 15:17:58.042484 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:58.042464    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s87zw" event={"ID":"dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc","Type":"ContainerStarted","Data":"4895100c5572c78e5fae5a5333f1070b0dfc4b03fb15bb19131f5bc002d1b361"}
Sep 10 15:17:59.048364 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:17:59.048331    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-c2d27" event={"ID":"c2daa35c-0530-448c-82d6-51be02389e4b","Type":"ContainerStarted","Data":"9a796c16ccd51c69ac5cea5927fa2d72f0ad02d8b02f03658c9c4aa09884751e"}
Sep 10 15:18:00.053707 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:00.053662    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s87zw" event={"ID":"dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc","Type":"ContainerStarted","Data":"34bada993152f3a7e2af0192ebfae2170750269ccba807700789b560e452fd53"}
Sep 10 15:18:00.054184 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:00.053719    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s87zw" event={"ID":"dc21bf10-3b7b-4ad2-b17c-fc5fcae1e2dc","Type":"ContainerStarted","Data":"337a98cc59e982ee63cac6f2e9c41475690e2059ab7f491d9801a2fb048c5704"}
Sep 10 15:18:00.073217 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:00.073162    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s87zw" podStartSLOduration=131.59972249 podStartE2EDuration="2m13.073145702s" totalImagesPullingTime="1.473423212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:18:00.071476793 +0000 UTC m=+133.121275301" watchObservedRunningTime="2026-09-10 15:18:00.073145702 +0000 UTC m=+133.122944208"
Sep 10 15:18:17.091484 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:17.091435    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66449cb6b7-t9hc9" podUID="0ab2b330-dc17-498d-b7b3-1fcbb30aff44" containerName="console" containerID="cri-o://9583c3fcbf254c3f393040987db11bf958952832f29bfe7b4af7013a6ac78cee" gracePeriod=15
Sep 10 15:18:17.367699 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:17.367629    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:18:17.503493 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:17.503460    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-oauth-serving-cert\") pod \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") "
Sep 10 15:18:17.503678 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:17.503525    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-console-serving-cert\") pod \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") "
Sep 10 15:18:17.503678 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:17.503548    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-service-ca\") pod \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") "
Sep 10 15:18:17.503678 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:17.503589    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-console-config\") pod \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") "
Sep 10 15:18:17.503678 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:17.503641    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vbqz\" (UniqueName: \"kubernetes.io/projected/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-kube-api-access-9vbqz\") pod \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") "
Sep 10 15:18:17.503678 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:17.503672    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-console-oauth-config\") pod \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\" (UID: \"0ab2b330-dc17-498d-b7b3-1fcbb30aff44\") "
Sep 10 15:18:17.504080 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:17.504051    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-service-ca" (OuterVolumeSpecName: "service-ca") pod "0ab2b330-dc17-498d-b7b3-1fcbb30aff44" (UID: "0ab2b330-dc17-498d-b7b3-1fcbb30aff44"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:18:17.504204 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:17.503961    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0ab2b330-dc17-498d-b7b3-1fcbb30aff44" (UID: "0ab2b330-dc17-498d-b7b3-1fcbb30aff44"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:18:17.504204 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:17.504158    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-console-config" (OuterVolumeSpecName: "console-config") pod "0ab2b330-dc17-498d-b7b3-1fcbb30aff44" (UID: "0ab2b330-dc17-498d-b7b3-1fcbb30aff44"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:18:17.505865 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:17.505834    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0ab2b330-dc17-498d-b7b3-1fcbb30aff44" (UID: "0ab2b330-dc17-498d-b7b3-1fcbb30aff44"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:18:17.505990 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:17.505856    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0ab2b330-dc17-498d-b7b3-1fcbb30aff44" (UID: "0ab2b330-dc17-498d-b7b3-1fcbb30aff44"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:18:17.505990 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:17.505910    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-kube-api-access-9vbqz" (OuterVolumeSpecName: "kube-api-access-9vbqz") pod "0ab2b330-dc17-498d-b7b3-1fcbb30aff44" (UID: "0ab2b330-dc17-498d-b7b3-1fcbb30aff44"). InnerVolumeSpecName "kube-api-access-9vbqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:18:17.605060 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:17.605021    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vbqz\" (UniqueName: \"kubernetes.io/projected/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-kube-api-access-9vbqz\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:18:17.605060 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:17.605050    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-console-oauth-config\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:18:17.605060 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:17.605060    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-oauth-serving-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:18:17.605060 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:17.605069    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-console-serving-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:18:17.605321 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:17.605078    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-service-ca\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:18:17.605321 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:17.605087    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ab2b330-dc17-498d-b7b3-1fcbb30aff44-console-config\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:18:18.126630 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:18.126598    2574 generic.go:356] "Generic (PLEG): container finished" podID="0ab2b330-dc17-498d-b7b3-1fcbb30aff44" containerID="9583c3fcbf254c3f393040987db11bf958952832f29bfe7b4af7013a6ac78cee" exitCode=0
Sep 10 15:18:18.127083 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:18.126636    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66449cb6b7-t9hc9" event={"ID":"0ab2b330-dc17-498d-b7b3-1fcbb30aff44","Type":"ContainerDied","Data":"9583c3fcbf254c3f393040987db11bf958952832f29bfe7b4af7013a6ac78cee"}
Sep 10 15:18:18.127083 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:18.126644    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66449cb6b7-t9hc9"
Sep 10 15:18:18.127083 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:18.126672    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66449cb6b7-t9hc9" event={"ID":"0ab2b330-dc17-498d-b7b3-1fcbb30aff44","Type":"ContainerDied","Data":"71d89e2d8abf37d9befaa8f6034a5846d7d8145adc9ebfebe943c3ec4555a9f8"}
Sep 10 15:18:18.127083 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:18.126692    2574 scope.go:117] "RemoveContainer" containerID="9583c3fcbf254c3f393040987db11bf958952832f29bfe7b4af7013a6ac78cee"
Sep 10 15:18:18.135284 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:18.135266    2574 scope.go:117] "RemoveContainer" containerID="9583c3fcbf254c3f393040987db11bf958952832f29bfe7b4af7013a6ac78cee"
Sep 10 15:18:18.135528 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:18:18.135510    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9583c3fcbf254c3f393040987db11bf958952832f29bfe7b4af7013a6ac78cee\": container with ID starting with 9583c3fcbf254c3f393040987db11bf958952832f29bfe7b4af7013a6ac78cee not found: ID does not exist" containerID="9583c3fcbf254c3f393040987db11bf958952832f29bfe7b4af7013a6ac78cee"
Sep 10 15:18:18.135570 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:18.135536    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9583c3fcbf254c3f393040987db11bf958952832f29bfe7b4af7013a6ac78cee"} err="failed to get container status \"9583c3fcbf254c3f393040987db11bf958952832f29bfe7b4af7013a6ac78cee\": rpc error: code = NotFound desc = could not find container \"9583c3fcbf254c3f393040987db11bf958952832f29bfe7b4af7013a6ac78cee\": container with ID starting with 9583c3fcbf254c3f393040987db11bf958952832f29bfe7b4af7013a6ac78cee not found: ID does not exist"
Sep 10 15:18:18.148347 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:18.148323    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66449cb6b7-t9hc9"]
Sep 10 15:18:18.152000 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:18.151982    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66449cb6b7-t9hc9"]
Sep 10 15:18:19.408587 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:19.408550    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ab2b330-dc17-498d-b7b3-1fcbb30aff44" path="/var/lib/kubelet/pods/0ab2b330-dc17-498d-b7b3-1fcbb30aff44/volumes"
Sep 10 15:18:34.003833 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.003795    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7599c7c697-thx7t"]
Sep 10 15:18:34.004557 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.004200    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ab2b330-dc17-498d-b7b3-1fcbb30aff44" containerName="console"
Sep 10 15:18:34.004557 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.004219    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ab2b330-dc17-498d-b7b3-1fcbb30aff44" containerName="console"
Sep 10 15:18:34.004557 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.004316    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ab2b330-dc17-498d-b7b3-1fcbb30aff44" containerName="console"
Sep 10 15:18:34.007042 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.007023    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.018524 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.018500    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7599c7c697-thx7t"]
Sep 10 15:18:34.149110 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.149060    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-service-ca\") pod \"console-7599c7c697-thx7t\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") " pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.149294 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.149134    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-trusted-ca-bundle\") pod \"console-7599c7c697-thx7t\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") " pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.149294 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.149170    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpl78\" (UniqueName: \"kubernetes.io/projected/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-kube-api-access-tpl78\") pod \"console-7599c7c697-thx7t\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") " pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.149294 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.149192    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-console-oauth-config\") pod \"console-7599c7c697-thx7t\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") " pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.149294 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.149249    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-console-config\") pod \"console-7599c7c697-thx7t\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") " pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.149294 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.149281    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-console-serving-cert\") pod \"console-7599c7c697-thx7t\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") " pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.149469 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.149305    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-oauth-serving-cert\") pod \"console-7599c7c697-thx7t\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") " pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.250073 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.250032    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpl78\" (UniqueName: \"kubernetes.io/projected/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-kube-api-access-tpl78\") pod \"console-7599c7c697-thx7t\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") " pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.250073 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.250080    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-console-oauth-config\") pod \"console-7599c7c697-thx7t\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") " pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.250302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.250099    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-console-config\") pod \"console-7599c7c697-thx7t\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") " pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.250302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.250117    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-console-serving-cert\") pod \"console-7599c7c697-thx7t\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") " pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.250302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.250133    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-oauth-serving-cert\") pod \"console-7599c7c697-thx7t\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") " pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.250302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.250189    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-service-ca\") pod \"console-7599c7c697-thx7t\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") " pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.250302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.250271    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-trusted-ca-bundle\") pod \"console-7599c7c697-thx7t\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") " pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.250995 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.250962    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-console-config\") pod \"console-7599c7c697-thx7t\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") " pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.251138 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.250998    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-oauth-serving-cert\") pod \"console-7599c7c697-thx7t\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") " pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.251138 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.251038    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-service-ca\") pod \"console-7599c7c697-thx7t\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") " pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.251263 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.251161    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-trusted-ca-bundle\") pod \"console-7599c7c697-thx7t\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") " pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.252670 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.252643    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-console-serving-cert\") pod \"console-7599c7c697-thx7t\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") " pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.252794 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.252750    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-console-oauth-config\") pod \"console-7599c7c697-thx7t\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") " pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.280083 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.279977    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpl78\" (UniqueName: \"kubernetes.io/projected/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-kube-api-access-tpl78\") pod \"console-7599c7c697-thx7t\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") " pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.318324 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.318288    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:34.588849 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:34.588822    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7599c7c697-thx7t"]
Sep 10 15:18:34.591330 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:18:34.591303    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1ca85fe_ba35_4e18_8669_0d23e2c3718a.slice/crio-1944a7bd06fb535811a0718fed061b1254950f3bb2f80edfa4d49fc49732d883 WatchSource:0}: Error finding container 1944a7bd06fb535811a0718fed061b1254950f3bb2f80edfa4d49fc49732d883: Status 404 returned error can't find the container with id 1944a7bd06fb535811a0718fed061b1254950f3bb2f80edfa4d49fc49732d883
Sep 10 15:18:35.196138 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:35.196102    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7599c7c697-thx7t" event={"ID":"a1ca85fe-ba35-4e18-8669-0d23e2c3718a","Type":"ContainerStarted","Data":"f449aee17217851bef0b712267a3e4bf6d41a47ca8cf5298ee02484171179857"}
Sep 10 15:18:35.196508 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:35.196151    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7599c7c697-thx7t" event={"ID":"a1ca85fe-ba35-4e18-8669-0d23e2c3718a","Type":"ContainerStarted","Data":"1944a7bd06fb535811a0718fed061b1254950f3bb2f80edfa4d49fc49732d883"}
Sep 10 15:18:35.217843 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:35.217774    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7599c7c697-thx7t" podStartSLOduration=2.217757884 podStartE2EDuration="2.217757884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:18:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:18:35.215667846 +0000 UTC m=+168.265466355" watchObservedRunningTime="2026-09-10 15:18:35.217757884 +0000 UTC m=+168.267556713"
Sep 10 15:18:44.319471 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:44.319363    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:44.319977 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:44.319465    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:44.324335 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:44.324315    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:45.239683 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:45.239655    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:18:45.287168 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:18:45.287130    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c94d546bc-4c9bs"]
Sep 10 15:19:10.307957 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.307901    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c94d546bc-4c9bs" podUID="ddc71a06-8787-44d3-b051-0bf60d2dbf5a" containerName="console" containerID="cri-o://c537386908230d40cf21ace64da6515b4df8ad61d50a2538e880c844ce91d6e8" gracePeriod=15
Sep 10 15:19:10.548747 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.548723    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:19:10.643199 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.643117    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-trusted-ca-bundle\") pod \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") "
Sep 10 15:19:10.643199 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.643166    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-console-config\") pod \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") "
Sep 10 15:19:10.643199 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.643195    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-oauth-serving-cert\") pod \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") "
Sep 10 15:19:10.643454 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.643251    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-console-oauth-config\") pod \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") "
Sep 10 15:19:10.643454 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.643299    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-service-ca\") pod \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") "
Sep 10 15:19:10.643454 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.643331    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wsfw\" (UniqueName: \"kubernetes.io/projected/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-kube-api-access-9wsfw\") pod \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") "
Sep 10 15:19:10.643454 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.643383    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-console-serving-cert\") pod \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\" (UID: \"ddc71a06-8787-44d3-b051-0bf60d2dbf5a\") "
Sep 10 15:19:10.643657 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.643518    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ddc71a06-8787-44d3-b051-0bf60d2dbf5a" (UID: "ddc71a06-8787-44d3-b051-0bf60d2dbf5a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:19:10.643657 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.643560    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ddc71a06-8787-44d3-b051-0bf60d2dbf5a" (UID: "ddc71a06-8787-44d3-b051-0bf60d2dbf5a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:19:10.643657 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.643608    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-console-config" (OuterVolumeSpecName: "console-config") pod "ddc71a06-8787-44d3-b051-0bf60d2dbf5a" (UID: "ddc71a06-8787-44d3-b051-0bf60d2dbf5a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:19:10.643657 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.643653    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-oauth-serving-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:19:10.643815 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.643672    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-trusted-ca-bundle\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:19:10.643815 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.643696    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-service-ca" (OuterVolumeSpecName: "service-ca") pod "ddc71a06-8787-44d3-b051-0bf60d2dbf5a" (UID: "ddc71a06-8787-44d3-b051-0bf60d2dbf5a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:19:10.645459 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.645436    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ddc71a06-8787-44d3-b051-0bf60d2dbf5a" (UID: "ddc71a06-8787-44d3-b051-0bf60d2dbf5a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:19:10.645537 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.645456    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ddc71a06-8787-44d3-b051-0bf60d2dbf5a" (UID: "ddc71a06-8787-44d3-b051-0bf60d2dbf5a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:19:10.645537 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.645521    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-kube-api-access-9wsfw" (OuterVolumeSpecName: "kube-api-access-9wsfw") pod "ddc71a06-8787-44d3-b051-0bf60d2dbf5a" (UID: "ddc71a06-8787-44d3-b051-0bf60d2dbf5a"). InnerVolumeSpecName "kube-api-access-9wsfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:19:10.744284 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.744246    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-console-serving-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:19:10.744284 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.744279    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-console-config\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:19:10.744284 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.744292    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-console-oauth-config\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:19:10.744513 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.744303    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-service-ca\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:19:10.744513 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:10.744316    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wsfw\" (UniqueName: \"kubernetes.io/projected/ddc71a06-8787-44d3-b051-0bf60d2dbf5a-kube-api-access-9wsfw\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:19:11.332516 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:11.332481    2574 generic.go:356] "Generic (PLEG): container finished" podID="ddc71a06-8787-44d3-b051-0bf60d2dbf5a" containerID="c537386908230d40cf21ace64da6515b4df8ad61d50a2538e880c844ce91d6e8" exitCode=0
Sep 10 15:19:11.332958 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:11.332531    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c94d546bc-4c9bs"
Sep 10 15:19:11.332958 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:11.332565    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c94d546bc-4c9bs" event={"ID":"ddc71a06-8787-44d3-b051-0bf60d2dbf5a","Type":"ContainerDied","Data":"c537386908230d40cf21ace64da6515b4df8ad61d50a2538e880c844ce91d6e8"}
Sep 10 15:19:11.332958 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:11.332614    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c94d546bc-4c9bs" event={"ID":"ddc71a06-8787-44d3-b051-0bf60d2dbf5a","Type":"ContainerDied","Data":"e276fd599a45ecc6c85667877907b513ab0eae621441debca89057cc63abdc17"}
Sep 10 15:19:11.332958 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:11.332634    2574 scope.go:117] "RemoveContainer" containerID="c537386908230d40cf21ace64da6515b4df8ad61d50a2538e880c844ce91d6e8"
Sep 10 15:19:11.340894 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:11.340878    2574 scope.go:117] "RemoveContainer" containerID="c537386908230d40cf21ace64da6515b4df8ad61d50a2538e880c844ce91d6e8"
Sep 10 15:19:11.341177 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:19:11.341160    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c537386908230d40cf21ace64da6515b4df8ad61d50a2538e880c844ce91d6e8\": container with ID starting with c537386908230d40cf21ace64da6515b4df8ad61d50a2538e880c844ce91d6e8 not found: ID does not exist" containerID="c537386908230d40cf21ace64da6515b4df8ad61d50a2538e880c844ce91d6e8"
Sep 10 15:19:11.341238 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:11.341184    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c537386908230d40cf21ace64da6515b4df8ad61d50a2538e880c844ce91d6e8"} err="failed to get container status \"c537386908230d40cf21ace64da6515b4df8ad61d50a2538e880c844ce91d6e8\": rpc error: code = NotFound desc = could not find container \"c537386908230d40cf21ace64da6515b4df8ad61d50a2538e880c844ce91d6e8\": container with ID starting with c537386908230d40cf21ace64da6515b4df8ad61d50a2538e880c844ce91d6e8 not found: ID does not exist"
Sep 10 15:19:11.353788 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:11.353765    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c94d546bc-4c9bs"]
Sep 10 15:19:11.357280 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:11.357256    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c94d546bc-4c9bs"]
Sep 10 15:19:11.407782 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:11.407751    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddc71a06-8787-44d3-b051-0bf60d2dbf5a" path="/var/lib/kubelet/pods/ddc71a06-8787-44d3-b051-0bf60d2dbf5a/volumes"
Sep 10 15:19:31.525753 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:31.525719    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh"]
Sep 10 15:19:31.526228 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:31.526036    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddc71a06-8787-44d3-b051-0bf60d2dbf5a" containerName="console"
Sep 10 15:19:31.526228 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:31.526047    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddc71a06-8787-44d3-b051-0bf60d2dbf5a" containerName="console"
Sep 10 15:19:31.526228 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:31.526097    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddc71a06-8787-44d3-b051-0bf60d2dbf5a" containerName="console"
Sep 10 15:19:31.529127 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:31.529109    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh"
Sep 10 15:19:31.531976 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:31.531954    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 15:19:31.531976 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:31.531970    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zcmdn\""
Sep 10 15:19:31.532144 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:31.532001    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 15:19:31.537871 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:31.537848    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh"]
Sep 10 15:19:31.617240 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:31.617206    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed2fe150-57f4-454c-9764-e8ebff9bba2e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh\" (UID: \"ed2fe150-57f4-454c-9764-e8ebff9bba2e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh"
Sep 10 15:19:31.617240 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:31.617244    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84wjh\" (UniqueName: \"kubernetes.io/projected/ed2fe150-57f4-454c-9764-e8ebff9bba2e-kube-api-access-84wjh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh\" (UID: \"ed2fe150-57f4-454c-9764-e8ebff9bba2e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh"
Sep 10 15:19:31.617477 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:31.617393    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed2fe150-57f4-454c-9764-e8ebff9bba2e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh\" (UID: \"ed2fe150-57f4-454c-9764-e8ebff9bba2e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh"
Sep 10 15:19:31.718581 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:31.718529    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed2fe150-57f4-454c-9764-e8ebff9bba2e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh\" (UID: \"ed2fe150-57f4-454c-9764-e8ebff9bba2e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh"
Sep 10 15:19:31.718767 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:31.718598    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed2fe150-57f4-454c-9764-e8ebff9bba2e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh\" (UID: \"ed2fe150-57f4-454c-9764-e8ebff9bba2e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh"
Sep 10 15:19:31.718767 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:31.718628    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84wjh\" (UniqueName: \"kubernetes.io/projected/ed2fe150-57f4-454c-9764-e8ebff9bba2e-kube-api-access-84wjh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh\" (UID: \"ed2fe150-57f4-454c-9764-e8ebff9bba2e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh"
Sep 10 15:19:31.718996 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:31.718972    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed2fe150-57f4-454c-9764-e8ebff9bba2e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh\" (UID: \"ed2fe150-57f4-454c-9764-e8ebff9bba2e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh"
Sep 10 15:19:31.719071 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:31.719009    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed2fe150-57f4-454c-9764-e8ebff9bba2e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh\" (UID: \"ed2fe150-57f4-454c-9764-e8ebff9bba2e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh"
Sep 10 15:19:31.728140 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:31.728111    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84wjh\" (UniqueName: \"kubernetes.io/projected/ed2fe150-57f4-454c-9764-e8ebff9bba2e-kube-api-access-84wjh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh\" (UID: \"ed2fe150-57f4-454c-9764-e8ebff9bba2e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh"
Sep 10 15:19:31.838005 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:31.837976    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh"
Sep 10 15:19:32.107166 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:32.107092    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh"]
Sep 10 15:19:32.110511 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:19:32.110486    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2fe150_57f4_454c_9764_e8ebff9bba2e.slice/crio-4dd8a98f0383de1402a947539802ce8db522b36f8dbbc851538c48a16d7a0fe4 WatchSource:0}: Error finding container 4dd8a98f0383de1402a947539802ce8db522b36f8dbbc851538c48a16d7a0fe4: Status 404 returned error can't find the container with id 4dd8a98f0383de1402a947539802ce8db522b36f8dbbc851538c48a16d7a0fe4
Sep 10 15:19:32.412020 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:32.411914    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh" event={"ID":"ed2fe150-57f4-454c-9764-e8ebff9bba2e","Type":"ContainerStarted","Data":"4dd8a98f0383de1402a947539802ce8db522b36f8dbbc851538c48a16d7a0fe4"}
Sep 10 15:19:39.439308 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:39.439268    2574 generic.go:356] "Generic (PLEG): container finished" podID="ed2fe150-57f4-454c-9764-e8ebff9bba2e" containerID="4535704463f298f86a025ec233c353afb0b575a62b66059b75d2f72ed0a3b000" exitCode=0
Sep 10 15:19:39.439763 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:39.439314    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh" event={"ID":"ed2fe150-57f4-454c-9764-e8ebff9bba2e","Type":"ContainerDied","Data":"4535704463f298f86a025ec233c353afb0b575a62b66059b75d2f72ed0a3b000"}
Sep 10 15:19:42.454609 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:42.454576    2574 generic.go:356] "Generic (PLEG): container finished" podID="ed2fe150-57f4-454c-9764-e8ebff9bba2e" containerID="4d744ad54b94902b385fc9dac4ae4405972ad7c3a88a4517ba93b0f76e452d17" exitCode=0
Sep 10 15:19:42.455092 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:42.454633    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh" event={"ID":"ed2fe150-57f4-454c-9764-e8ebff9bba2e","Type":"ContainerDied","Data":"4d744ad54b94902b385fc9dac4ae4405972ad7c3a88a4517ba93b0f76e452d17"}
Sep 10 15:19:49.485984 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:49.485948    2574 generic.go:356] "Generic (PLEG): container finished" podID="ed2fe150-57f4-454c-9764-e8ebff9bba2e" containerID="6a0c2cbbbae9e9825500cc779e15fc01fa75dcffa0a4bd05c2d80e66a66dff5e" exitCode=0
Sep 10 15:19:49.486414 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:49.485991    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh" event={"ID":"ed2fe150-57f4-454c-9764-e8ebff9bba2e","Type":"ContainerDied","Data":"6a0c2cbbbae9e9825500cc779e15fc01fa75dcffa0a4bd05c2d80e66a66dff5e"}
Sep 10 15:19:50.609461 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:50.609429    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh"
Sep 10 15:19:50.672181 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:50.672148    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed2fe150-57f4-454c-9764-e8ebff9bba2e-bundle\") pod \"ed2fe150-57f4-454c-9764-e8ebff9bba2e\" (UID: \"ed2fe150-57f4-454c-9764-e8ebff9bba2e\") "
Sep 10 15:19:50.672358 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:50.672191    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed2fe150-57f4-454c-9764-e8ebff9bba2e-util\") pod \"ed2fe150-57f4-454c-9764-e8ebff9bba2e\" (UID: \"ed2fe150-57f4-454c-9764-e8ebff9bba2e\") "
Sep 10 15:19:50.672358 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:50.672226    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84wjh\" (UniqueName: \"kubernetes.io/projected/ed2fe150-57f4-454c-9764-e8ebff9bba2e-kube-api-access-84wjh\") pod \"ed2fe150-57f4-454c-9764-e8ebff9bba2e\" (UID: \"ed2fe150-57f4-454c-9764-e8ebff9bba2e\") "
Sep 10 15:19:50.672993 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:50.672966    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed2fe150-57f4-454c-9764-e8ebff9bba2e-bundle" (OuterVolumeSpecName: "bundle") pod "ed2fe150-57f4-454c-9764-e8ebff9bba2e" (UID: "ed2fe150-57f4-454c-9764-e8ebff9bba2e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:19:50.674499 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:50.674471    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed2fe150-57f4-454c-9764-e8ebff9bba2e-kube-api-access-84wjh" (OuterVolumeSpecName: "kube-api-access-84wjh") pod "ed2fe150-57f4-454c-9764-e8ebff9bba2e" (UID: "ed2fe150-57f4-454c-9764-e8ebff9bba2e"). InnerVolumeSpecName "kube-api-access-84wjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:19:50.677036 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:50.677016    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed2fe150-57f4-454c-9764-e8ebff9bba2e-util" (OuterVolumeSpecName: "util") pod "ed2fe150-57f4-454c-9764-e8ebff9bba2e" (UID: "ed2fe150-57f4-454c-9764-e8ebff9bba2e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:19:50.773446 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:50.773369    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed2fe150-57f4-454c-9764-e8ebff9bba2e-bundle\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:19:50.773446 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:50.773394    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed2fe150-57f4-454c-9764-e8ebff9bba2e-util\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:19:50.773446 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:50.773403    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84wjh\" (UniqueName: \"kubernetes.io/projected/ed2fe150-57f4-454c-9764-e8ebff9bba2e-kube-api-access-84wjh\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:19:51.496370 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:51.496331    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh" event={"ID":"ed2fe150-57f4-454c-9764-e8ebff9bba2e","Type":"ContainerDied","Data":"4dd8a98f0383de1402a947539802ce8db522b36f8dbbc851538c48a16d7a0fe4"}
Sep 10 15:19:51.496527 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:51.496384    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lj7nh"
Sep 10 15:19:51.496527 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:51.496390    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4dd8a98f0383de1402a947539802ce8db522b36f8dbbc851538c48a16d7a0fe4"
Sep 10 15:19:54.887924 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:54.887891    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sq4sj"]
Sep 10 15:19:54.888336 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:54.888176    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed2fe150-57f4-454c-9764-e8ebff9bba2e" containerName="pull"
Sep 10 15:19:54.888336 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:54.888187    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed2fe150-57f4-454c-9764-e8ebff9bba2e" containerName="pull"
Sep 10 15:19:54.888336 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:54.888203    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed2fe150-57f4-454c-9764-e8ebff9bba2e" containerName="util"
Sep 10 15:19:54.888336 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:54.888208    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed2fe150-57f4-454c-9764-e8ebff9bba2e" containerName="util"
Sep 10 15:19:54.888336 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:54.888218    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed2fe150-57f4-454c-9764-e8ebff9bba2e" containerName="extract"
Sep 10 15:19:54.888336 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:54.888223    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed2fe150-57f4-454c-9764-e8ebff9bba2e" containerName="extract"
Sep 10 15:19:54.888336 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:54.888267    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed2fe150-57f4-454c-9764-e8ebff9bba2e" containerName="extract"
Sep 10 15:19:54.891563 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:54.891547    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sq4sj"
Sep 10 15:19:54.894686 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:54.894667    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 10 15:19:54.895224 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:54.895206    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-9wpft\""
Sep 10 15:19:54.895324 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:54.895305    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 10 15:19:54.906454 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:54.906431    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sq4sj"]
Sep 10 15:19:55.006850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:55.006811    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrxtj\" (UniqueName: \"kubernetes.io/projected/e24ac1e2-c87b-4064-9129-da5972a34a3b-kube-api-access-nrxtj\") pod \"cert-manager-operator-controller-manager-55c444bf86-sq4sj\" (UID: \"e24ac1e2-c87b-4064-9129-da5972a34a3b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sq4sj"
Sep 10 15:19:55.007040 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:55.006870    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e24ac1e2-c87b-4064-9129-da5972a34a3b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sq4sj\" (UID: \"e24ac1e2-c87b-4064-9129-da5972a34a3b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sq4sj"
Sep 10 15:19:55.108240 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:55.108205    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrxtj\" (UniqueName: \"kubernetes.io/projected/e24ac1e2-c87b-4064-9129-da5972a34a3b-kube-api-access-nrxtj\") pod \"cert-manager-operator-controller-manager-55c444bf86-sq4sj\" (UID: \"e24ac1e2-c87b-4064-9129-da5972a34a3b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sq4sj"
Sep 10 15:19:55.108412 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:55.108258    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e24ac1e2-c87b-4064-9129-da5972a34a3b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sq4sj\" (UID: \"e24ac1e2-c87b-4064-9129-da5972a34a3b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sq4sj"
Sep 10 15:19:55.108605 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:55.108589    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e24ac1e2-c87b-4064-9129-da5972a34a3b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sq4sj\" (UID: \"e24ac1e2-c87b-4064-9129-da5972a34a3b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sq4sj"
Sep 10 15:19:55.117715 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:55.117683    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrxtj\" (UniqueName: \"kubernetes.io/projected/e24ac1e2-c87b-4064-9129-da5972a34a3b-kube-api-access-nrxtj\") pod \"cert-manager-operator-controller-manager-55c444bf86-sq4sj\" (UID: \"e24ac1e2-c87b-4064-9129-da5972a34a3b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sq4sj"
Sep 10 15:19:55.201006 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:55.200903    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sq4sj"
Sep 10 15:19:55.478224 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:55.478145    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sq4sj"]
Sep 10 15:19:55.481373 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:19:55.481347    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode24ac1e2_c87b_4064_9129_da5972a34a3b.slice/crio-4496c0b8bfe81c26a7930825b6031e8d03283da2f4bf41c982d0b2a5723e8d2f WatchSource:0}: Error finding container 4496c0b8bfe81c26a7930825b6031e8d03283da2f4bf41c982d0b2a5723e8d2f: Status 404 returned error can't find the container with id 4496c0b8bfe81c26a7930825b6031e8d03283da2f4bf41c982d0b2a5723e8d2f
Sep 10 15:19:55.512989 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:55.512960    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sq4sj" event={"ID":"e24ac1e2-c87b-4064-9129-da5972a34a3b","Type":"ContainerStarted","Data":"4496c0b8bfe81c26a7930825b6031e8d03283da2f4bf41c982d0b2a5723e8d2f"}
Sep 10 15:19:57.524809 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:57.524773    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sq4sj" event={"ID":"e24ac1e2-c87b-4064-9129-da5972a34a3b","Type":"ContainerStarted","Data":"85eec298342f69b8e68d36543cfdfd4158a7f9312c869750b350eddaa99982bb"}
Sep 10 15:19:57.550605 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:57.550542    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sq4sj" podStartSLOduration=2.014475822 podStartE2EDuration="3.550521024s" totalImagesPullingTime="1.536045202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:19:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:19:57.547720546 +0000 UTC m=+250.597519055" watchObservedRunningTime="2026-09-10 15:19:57.550521024 +0000 UTC m=+250.600319535"
Sep 10 15:19:58.783372 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:58.783330    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf"]
Sep 10 15:19:58.785638 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:58.785618    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf"
Sep 10 15:19:58.788524 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:58.788503    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zcmdn\""
Sep 10 15:19:58.788524 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:58.788517    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 15:19:58.789554 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:58.789537    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 15:19:58.796794 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:58.796773    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf"]
Sep 10 15:19:58.842710 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:58.842685    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf\" (UID: \"019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf"
Sep 10 15:19:58.842857 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:58.842735    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf\" (UID: \"019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf"
Sep 10 15:19:58.842857 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:58.842768    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bv8b\" (UniqueName: \"kubernetes.io/projected/019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56-kube-api-access-4bv8b\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf\" (UID: \"019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf"
Sep 10 15:19:58.944150 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:58.944112    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf\" (UID: \"019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf"
Sep 10 15:19:58.944350 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:58.944166    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bv8b\" (UniqueName: \"kubernetes.io/projected/019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56-kube-api-access-4bv8b\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf\" (UID: \"019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf"
Sep 10 15:19:58.944350 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:58.944210    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf\" (UID: \"019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf"
Sep 10 15:19:58.944580 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:58.944555    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf\" (UID: \"019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf"
Sep 10 15:19:58.944580 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:58.944570    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf\" (UID: \"019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf"
Sep 10 15:19:58.953347 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:58.953321    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bv8b\" (UniqueName: \"kubernetes.io/projected/019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56-kube-api-access-4bv8b\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf\" (UID: \"019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf"
Sep 10 15:19:59.095193 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:59.095156    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf"
Sep 10 15:19:59.368212 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:59.368134    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf"]
Sep 10 15:19:59.370779 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:19:59.370748    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod019ebaaf_5819_4ca5_94f4_cc2a6e6d0d56.slice/crio-36040d48e45b12541cf515c640f4ffc160c5c948e8d4a99e82d0a57e8c8557f0 WatchSource:0}: Error finding container 36040d48e45b12541cf515c640f4ffc160c5c948e8d4a99e82d0a57e8c8557f0: Status 404 returned error can't find the container with id 36040d48e45b12541cf515c640f4ffc160c5c948e8d4a99e82d0a57e8c8557f0
Sep 10 15:19:59.463197 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:59.463165    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r78np"]
Sep 10 15:19:59.465369 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:59.465253    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-r78np"
Sep 10 15:19:59.468125 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:59.468095    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 15:19:59.468125 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:59.468118    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6v6px\""
Sep 10 15:19:59.468248 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:59.468118    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 15:19:59.481168 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:59.481145    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r78np"]
Sep 10 15:19:59.534248 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:59.534218    2574 generic.go:356] "Generic (PLEG): container finished" podID="019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56" containerID="4146004c0adc69839c2abe922554f8b77c00ad3c4f9b50f8b3d5dade589aa5a1" exitCode=0
Sep 10 15:19:59.534380 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:59.534305    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf" event={"ID":"019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56","Type":"ContainerDied","Data":"4146004c0adc69839c2abe922554f8b77c00ad3c4f9b50f8b3d5dade589aa5a1"}
Sep 10 15:19:59.534380 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:59.534350    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf" event={"ID":"019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56","Type":"ContainerStarted","Data":"36040d48e45b12541cf515c640f4ffc160c5c948e8d4a99e82d0a57e8c8557f0"}
Sep 10 15:19:59.549640 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:59.549616    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab59ecd0-0e88-4627-b485-f733a2e5b5f9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r78np\" (UID: \"ab59ecd0-0e88-4627-b485-f733a2e5b5f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r78np"
Sep 10 15:19:59.549739 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:59.549669    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpcts\" (UniqueName: \"kubernetes.io/projected/ab59ecd0-0e88-4627-b485-f733a2e5b5f9-kube-api-access-kpcts\") pod \"cert-manager-webhook-6486ffd997-r78np\" (UID: \"ab59ecd0-0e88-4627-b485-f733a2e5b5f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r78np"
Sep 10 15:19:59.650258 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:59.650167    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab59ecd0-0e88-4627-b485-f733a2e5b5f9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r78np\" (UID: \"ab59ecd0-0e88-4627-b485-f733a2e5b5f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r78np"
Sep 10 15:19:59.650258 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:59.650247    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpcts\" (UniqueName: \"kubernetes.io/projected/ab59ecd0-0e88-4627-b485-f733a2e5b5f9-kube-api-access-kpcts\") pod \"cert-manager-webhook-6486ffd997-r78np\" (UID: \"ab59ecd0-0e88-4627-b485-f733a2e5b5f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r78np"
Sep 10 15:19:59.660097 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:59.660065    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab59ecd0-0e88-4627-b485-f733a2e5b5f9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r78np\" (UID: \"ab59ecd0-0e88-4627-b485-f733a2e5b5f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r78np"
Sep 10 15:19:59.660220 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:59.660134    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpcts\" (UniqueName: \"kubernetes.io/projected/ab59ecd0-0e88-4627-b485-f733a2e5b5f9-kube-api-access-kpcts\") pod \"cert-manager-webhook-6486ffd997-r78np\" (UID: \"ab59ecd0-0e88-4627-b485-f733a2e5b5f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r78np"
Sep 10 15:19:59.850703 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:19:59.850668    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-r78np"
Sep 10 15:20:00.121956 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:00.121001    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r78np"]
Sep 10 15:20:00.127103 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:20:00.127075    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab59ecd0_0e88_4627_b485_f733a2e5b5f9.slice/crio-4ad9096296b729c2b59f756d960794cff980602353693f2f73fc70fe2aef6795 WatchSource:0}: Error finding container 4ad9096296b729c2b59f756d960794cff980602353693f2f73fc70fe2aef6795: Status 404 returned error can't find the container with id 4ad9096296b729c2b59f756d960794cff980602353693f2f73fc70fe2aef6795
Sep 10 15:20:00.540478 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:00.540381    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-r78np" event={"ID":"ab59ecd0-0e88-4627-b485-f733a2e5b5f9","Type":"ContainerStarted","Data":"4ad9096296b729c2b59f756d960794cff980602353693f2f73fc70fe2aef6795"}
Sep 10 15:20:02.551659 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:02.551620    2574 generic.go:356] "Generic (PLEG): container finished" podID="019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56" containerID="b30c13882894080668e89052f4fd3e1ce913d2fa0bc3941bd3d3ba49b2ff8948" exitCode=0
Sep 10 15:20:02.552122 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:02.551695    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf" event={"ID":"019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56","Type":"ContainerDied","Data":"b30c13882894080668e89052f4fd3e1ce913d2fa0bc3941bd3d3ba49b2ff8948"}
Sep 10 15:20:03.560565 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:03.560530    2574 generic.go:356] "Generic (PLEG): container finished" podID="019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56" containerID="5ae73252d387d573b755f1b166f130b973a517c9937d0371c9109cd09caf74de" exitCode=0
Sep 10 15:20:03.560913 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:03.560572    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf" event={"ID":"019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56","Type":"ContainerDied","Data":"5ae73252d387d573b755f1b166f130b973a517c9937d0371c9109cd09caf74de"}
Sep 10 15:20:04.566611 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:04.566562    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-r78np" event={"ID":"ab59ecd0-0e88-4627-b485-f733a2e5b5f9","Type":"ContainerStarted","Data":"ad1b8640878a259a64ff7520c991dd0eca431782f479ba5b563d8e589283677f"}
Sep 10 15:20:04.567085 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:04.566838    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-r78np"
Sep 10 15:20:04.585112 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:04.585048    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-r78np" podStartSLOduration=2.211129328 podStartE2EDuration="5.585023807s" totalImagesPullingTime="3.373894479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:19:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:20:04.584602605 +0000 UTC m=+257.634401112" watchObservedRunningTime="2026-09-10 15:20:04.585023807 +0000 UTC m=+257.634822315"
Sep 10 15:20:04.691943 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:04.691911    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf"
Sep 10 15:20:04.792145 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:04.792112    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56-bundle\") pod \"019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56\" (UID: \"019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56\") "
Sep 10 15:20:04.792300 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:04.792168    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bv8b\" (UniqueName: \"kubernetes.io/projected/019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56-kube-api-access-4bv8b\") pod \"019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56\" (UID: \"019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56\") "
Sep 10 15:20:04.792300 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:04.792201    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56-util\") pod \"019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56\" (UID: \"019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56\") "
Sep 10 15:20:04.792557 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:04.792524    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56-bundle" (OuterVolumeSpecName: "bundle") pod "019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56" (UID: "019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:20:04.794334 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:04.794310    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56-kube-api-access-4bv8b" (OuterVolumeSpecName: "kube-api-access-4bv8b") pod "019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56" (UID: "019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56"). InnerVolumeSpecName "kube-api-access-4bv8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:20:04.797319 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:04.797295    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56-util" (OuterVolumeSpecName: "util") pod "019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56" (UID: "019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:20:04.893577 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:04.893488    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56-util\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:20:04.893577 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:04.893520    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56-bundle\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:20:04.893577 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:04.893528    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bv8b\" (UniqueName: \"kubernetes.io/projected/019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56-kube-api-access-4bv8b\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:20:05.572650 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:05.572617    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf"
Sep 10 15:20:05.572650 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:05.572642    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnmvf" event={"ID":"019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56","Type":"ContainerDied","Data":"36040d48e45b12541cf515c640f4ffc160c5c948e8d4a99e82d0a57e8c8557f0"}
Sep 10 15:20:05.573099 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:05.572685    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36040d48e45b12541cf515c640f4ffc160c5c948e8d4a99e82d0a57e8c8557f0"
Sep 10 15:20:08.722163 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:08.722129    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bzms7"]
Sep 10 15:20:08.722546 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:08.722411    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56" containerName="util"
Sep 10 15:20:08.722546 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:08.722423    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56" containerName="util"
Sep 10 15:20:08.722546 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:08.722442    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56" containerName="extract"
Sep 10 15:20:08.722546 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:08.722448    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56" containerName="extract"
Sep 10 15:20:08.722546 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:08.722464    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56" containerName="pull"
Sep 10 15:20:08.722546 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:08.722469    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56" containerName="pull"
Sep 10 15:20:08.722546 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:08.722511    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="019ebaaf-5819-4ca5-94f4-cc2a6e6d0d56" containerName="extract"
Sep 10 15:20:08.725231 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:08.725215    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-bzms7"
Sep 10 15:20:08.727796 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:08.727774    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-g5qjd\""
Sep 10 15:20:08.737093 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:08.737069    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bzms7"]
Sep 10 15:20:08.827552 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:08.827515    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf5lw\" (UniqueName: \"kubernetes.io/projected/d34fc357-cbc4-45c6-9fda-0866381f792e-kube-api-access-rf5lw\") pod \"cert-manager-55b4d954d5-bzms7\" (UID: \"d34fc357-cbc4-45c6-9fda-0866381f792e\") " pod="cert-manager/cert-manager-55b4d954d5-bzms7"
Sep 10 15:20:08.827723 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:08.827604    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d34fc357-cbc4-45c6-9fda-0866381f792e-bound-sa-token\") pod \"cert-manager-55b4d954d5-bzms7\" (UID: \"d34fc357-cbc4-45c6-9fda-0866381f792e\") " pod="cert-manager/cert-manager-55b4d954d5-bzms7"
Sep 10 15:20:08.928259 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:08.928222    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d34fc357-cbc4-45c6-9fda-0866381f792e-bound-sa-token\") pod \"cert-manager-55b4d954d5-bzms7\" (UID: \"d34fc357-cbc4-45c6-9fda-0866381f792e\") " pod="cert-manager/cert-manager-55b4d954d5-bzms7"
Sep 10 15:20:08.928392 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:08.928265    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf5lw\" (UniqueName: \"kubernetes.io/projected/d34fc357-cbc4-45c6-9fda-0866381f792e-kube-api-access-rf5lw\") pod \"cert-manager-55b4d954d5-bzms7\" (UID: \"d34fc357-cbc4-45c6-9fda-0866381f792e\") " pod="cert-manager/cert-manager-55b4d954d5-bzms7"
Sep 10 15:20:08.937160 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:08.937125    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d34fc357-cbc4-45c6-9fda-0866381f792e-bound-sa-token\") pod \"cert-manager-55b4d954d5-bzms7\" (UID: \"d34fc357-cbc4-45c6-9fda-0866381f792e\") " pod="cert-manager/cert-manager-55b4d954d5-bzms7"
Sep 10 15:20:08.937409 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:08.937381    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf5lw\" (UniqueName: \"kubernetes.io/projected/d34fc357-cbc4-45c6-9fda-0866381f792e-kube-api-access-rf5lw\") pod \"cert-manager-55b4d954d5-bzms7\" (UID: \"d34fc357-cbc4-45c6-9fda-0866381f792e\") " pod="cert-manager/cert-manager-55b4d954d5-bzms7"
Sep 10 15:20:09.033944 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:09.033852    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-bzms7"
Sep 10 15:20:09.304287 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:09.304259    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bzms7"]
Sep 10 15:20:09.306543 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:20:09.306513    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd34fc357_cbc4_45c6_9fda_0866381f792e.slice/crio-18f8155e9956da7cdd8349ab10f6b5535eaa6f4be72deeade7fa77334daabf63 WatchSource:0}: Error finding container 18f8155e9956da7cdd8349ab10f6b5535eaa6f4be72deeade7fa77334daabf63: Status 404 returned error can't find the container with id 18f8155e9956da7cdd8349ab10f6b5535eaa6f4be72deeade7fa77334daabf63
Sep 10 15:20:09.591279 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:09.591188    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-bzms7" event={"ID":"d34fc357-cbc4-45c6-9fda-0866381f792e","Type":"ContainerStarted","Data":"3ef4c32b7ab3c96cb9ca99eb5037b76fb9f9f25864c2a42216c8da08467ca1c3"}
Sep 10 15:20:09.591279 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:09.591229    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-bzms7" event={"ID":"d34fc357-cbc4-45c6-9fda-0866381f792e","Type":"ContainerStarted","Data":"18f8155e9956da7cdd8349ab10f6b5535eaa6f4be72deeade7fa77334daabf63"}
Sep 10 15:20:09.629278 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:09.629217    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-bzms7" podStartSLOduration=1.6292008089999999 podStartE2EDuration="1.629200809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:20:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:20:09.628791732 +0000 UTC m=+262.678590242" watchObservedRunningTime="2026-09-10 15:20:09.629200809 +0000 UTC m=+262.678999442"
Sep 10 15:20:10.575332 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:10.575298    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-r78np"
Sep 10 15:20:16.378024 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:16.377986    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn"]
Sep 10 15:20:16.381506 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:16.381485    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn"
Sep 10 15:20:16.384363 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:16.384332    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 15:20:16.384466 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:16.384381    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zcmdn\""
Sep 10 15:20:16.385439 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:16.385420    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 15:20:16.391950 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:16.391914    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn"]
Sep 10 15:20:16.493429 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:16.493377    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5662p\" (UniqueName: \"kubernetes.io/projected/31182557-e108-4b56-985c-e0d784876cb0-kube-api-access-5662p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn\" (UID: \"31182557-e108-4b56-985c-e0d784876cb0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn"
Sep 10 15:20:16.493429 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:16.493434    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31182557-e108-4b56-985c-e0d784876cb0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn\" (UID: \"31182557-e108-4b56-985c-e0d784876cb0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn"
Sep 10 15:20:16.493653 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:16.493550    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31182557-e108-4b56-985c-e0d784876cb0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn\" (UID: \"31182557-e108-4b56-985c-e0d784876cb0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn"
Sep 10 15:20:16.594896 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:16.594850    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5662p\" (UniqueName: \"kubernetes.io/projected/31182557-e108-4b56-985c-e0d784876cb0-kube-api-access-5662p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn\" (UID: \"31182557-e108-4b56-985c-e0d784876cb0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn"
Sep 10 15:20:16.594896 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:16.594902    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31182557-e108-4b56-985c-e0d784876cb0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn\" (UID: \"31182557-e108-4b56-985c-e0d784876cb0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn"
Sep 10 15:20:16.595177 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:16.595021    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31182557-e108-4b56-985c-e0d784876cb0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn\" (UID: \"31182557-e108-4b56-985c-e0d784876cb0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn"
Sep 10 15:20:16.595307 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:16.595282    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31182557-e108-4b56-985c-e0d784876cb0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn\" (UID: \"31182557-e108-4b56-985c-e0d784876cb0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn"
Sep 10 15:20:16.595383 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:16.595332    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31182557-e108-4b56-985c-e0d784876cb0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn\" (UID: \"31182557-e108-4b56-985c-e0d784876cb0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn"
Sep 10 15:20:16.604256 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:16.604233    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5662p\" (UniqueName: \"kubernetes.io/projected/31182557-e108-4b56-985c-e0d784876cb0-kube-api-access-5662p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn\" (UID: \"31182557-e108-4b56-985c-e0d784876cb0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn"
Sep 10 15:20:16.691638 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:16.691546    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn"
Sep 10 15:20:16.964798 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:16.964775    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn"]
Sep 10 15:20:16.967257 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:20:16.967229    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31182557_e108_4b56_985c_e0d784876cb0.slice/crio-b10a45387254f60e2926d2e65b6344ab81e56a3b43d27fbe64183990c5a96833 WatchSource:0}: Error finding container b10a45387254f60e2926d2e65b6344ab81e56a3b43d27fbe64183990c5a96833: Status 404 returned error can't find the container with id b10a45387254f60e2926d2e65b6344ab81e56a3b43d27fbe64183990c5a96833
Sep 10 15:20:17.628757 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:17.628721    2574 generic.go:356] "Generic (PLEG): container finished" podID="31182557-e108-4b56-985c-e0d784876cb0" containerID="8d96eedb27b5ba4ae11f0d9e53a2c6e9cdef4b46e3d392f951339297f4d0cdf0" exitCode=0
Sep 10 15:20:17.629112 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:17.628806    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn" event={"ID":"31182557-e108-4b56-985c-e0d784876cb0","Type":"ContainerDied","Data":"8d96eedb27b5ba4ae11f0d9e53a2c6e9cdef4b46e3d392f951339297f4d0cdf0"}
Sep 10 15:20:17.629112 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:17.628854    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn" event={"ID":"31182557-e108-4b56-985c-e0d784876cb0","Type":"ContainerStarted","Data":"b10a45387254f60e2926d2e65b6344ab81e56a3b43d27fbe64183990c5a96833"}
Sep 10 15:20:18.635313 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:18.635284    2574 generic.go:356] "Generic (PLEG): container finished" podID="31182557-e108-4b56-985c-e0d784876cb0" containerID="05d0e9f9982d9f91d34e7171ec4379499c132774f5106a258f85d8b855731179" exitCode=0
Sep 10 15:20:18.635627 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:18.635354    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn" event={"ID":"31182557-e108-4b56-985c-e0d784876cb0","Type":"ContainerDied","Data":"05d0e9f9982d9f91d34e7171ec4379499c132774f5106a258f85d8b855731179"}
Sep 10 15:20:19.641763 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:19.641727    2574 generic.go:356] "Generic (PLEG): container finished" podID="31182557-e108-4b56-985c-e0d784876cb0" containerID="c96bdbb37c3de36d8adb14916ba0c9c812dd8eda0ed8a830594b9dd5194aaa1e" exitCode=0
Sep 10 15:20:19.642159 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:19.641793    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn" event={"ID":"31182557-e108-4b56-985c-e0d784876cb0","Type":"ContainerDied","Data":"c96bdbb37c3de36d8adb14916ba0c9c812dd8eda0ed8a830594b9dd5194aaa1e"}
Sep 10 15:20:20.794621 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:20.794588    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn"
Sep 10 15:20:20.932352 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:20.932268    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5662p\" (UniqueName: \"kubernetes.io/projected/31182557-e108-4b56-985c-e0d784876cb0-kube-api-access-5662p\") pod \"31182557-e108-4b56-985c-e0d784876cb0\" (UID: \"31182557-e108-4b56-985c-e0d784876cb0\") "
Sep 10 15:20:20.932352 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:20.932307    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31182557-e108-4b56-985c-e0d784876cb0-bundle\") pod \"31182557-e108-4b56-985c-e0d784876cb0\" (UID: \"31182557-e108-4b56-985c-e0d784876cb0\") "
Sep 10 15:20:20.932352 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:20.932337    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31182557-e108-4b56-985c-e0d784876cb0-util\") pod \"31182557-e108-4b56-985c-e0d784876cb0\" (UID: \"31182557-e108-4b56-985c-e0d784876cb0\") "
Sep 10 15:20:20.933010 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:20.932980    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31182557-e108-4b56-985c-e0d784876cb0-bundle" (OuterVolumeSpecName: "bundle") pod "31182557-e108-4b56-985c-e0d784876cb0" (UID: "31182557-e108-4b56-985c-e0d784876cb0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:20:20.934397 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:20.934367    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31182557-e108-4b56-985c-e0d784876cb0-kube-api-access-5662p" (OuterVolumeSpecName: "kube-api-access-5662p") pod "31182557-e108-4b56-985c-e0d784876cb0" (UID: "31182557-e108-4b56-985c-e0d784876cb0"). InnerVolumeSpecName "kube-api-access-5662p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:20:20.937878 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:20.937848    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31182557-e108-4b56-985c-e0d784876cb0-util" (OuterVolumeSpecName: "util") pod "31182557-e108-4b56-985c-e0d784876cb0" (UID: "31182557-e108-4b56-985c-e0d784876cb0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:20:21.033912 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:21.033877    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5662p\" (UniqueName: \"kubernetes.io/projected/31182557-e108-4b56-985c-e0d784876cb0-kube-api-access-5662p\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:20:21.033912 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:21.033907    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31182557-e108-4b56-985c-e0d784876cb0-bundle\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:20:21.033912 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:21.033916    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31182557-e108-4b56-985c-e0d784876cb0-util\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:20:21.652239 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:21.652209    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn"
Sep 10 15:20:21.652442 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:21.652209    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjqbn" event={"ID":"31182557-e108-4b56-985c-e0d784876cb0","Type":"ContainerDied","Data":"b10a45387254f60e2926d2e65b6344ab81e56a3b43d27fbe64183990c5a96833"}
Sep 10 15:20:21.652442 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:21.652331    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b10a45387254f60e2926d2e65b6344ab81e56a3b43d27fbe64183990c5a96833"
Sep 10 15:20:29.770052 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:29.770014    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d"]
Sep 10 15:20:29.770498 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:29.770308    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31182557-e108-4b56-985c-e0d784876cb0" containerName="pull"
Sep 10 15:20:29.770498 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:29.770319    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="31182557-e108-4b56-985c-e0d784876cb0" containerName="pull"
Sep 10 15:20:29.770498 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:29.770332    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31182557-e108-4b56-985c-e0d784876cb0" containerName="extract"
Sep 10 15:20:29.770498 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:29.770339    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="31182557-e108-4b56-985c-e0d784876cb0" containerName="extract"
Sep 10 15:20:29.770498 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:29.770350    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31182557-e108-4b56-985c-e0d784876cb0" containerName="util"
Sep 10 15:20:29.770498 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:29.770355    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="31182557-e108-4b56-985c-e0d784876cb0" containerName="util"
Sep 10 15:20:29.770498 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:29.770405    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="31182557-e108-4b56-985c-e0d784876cb0" containerName="extract"
Sep 10 15:20:29.772980 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:29.772963    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d"
Sep 10 15:20:29.776114 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:29.776093    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 15:20:29.777252 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:29.777234    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 15:20:29.777329 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:29.777234    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zcmdn\""
Sep 10 15:20:29.783854 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:29.783832    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d"]
Sep 10 15:20:29.907939 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:29.907901    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6x59\" (UniqueName: \"kubernetes.io/projected/4eb431cf-be99-43e3-b7ff-5d1c2db9e027-kube-api-access-v6x59\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d\" (UID: \"4eb431cf-be99-43e3-b7ff-5d1c2db9e027\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d"
Sep 10 15:20:29.908138 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:29.907987    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4eb431cf-be99-43e3-b7ff-5d1c2db9e027-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d\" (UID: \"4eb431cf-be99-43e3-b7ff-5d1c2db9e027\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d"
Sep 10 15:20:29.908138 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:29.908018    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4eb431cf-be99-43e3-b7ff-5d1c2db9e027-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d\" (UID: \"4eb431cf-be99-43e3-b7ff-5d1c2db9e027\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d"
Sep 10 15:20:30.009399 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:30.009355    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6x59\" (UniqueName: \"kubernetes.io/projected/4eb431cf-be99-43e3-b7ff-5d1c2db9e027-kube-api-access-v6x59\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d\" (UID: \"4eb431cf-be99-43e3-b7ff-5d1c2db9e027\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d"
Sep 10 15:20:30.009594 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:30.009412    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4eb431cf-be99-43e3-b7ff-5d1c2db9e027-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d\" (UID: \"4eb431cf-be99-43e3-b7ff-5d1c2db9e027\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d"
Sep 10 15:20:30.009594 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:30.009442    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4eb431cf-be99-43e3-b7ff-5d1c2db9e027-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d\" (UID: \"4eb431cf-be99-43e3-b7ff-5d1c2db9e027\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d"
Sep 10 15:20:30.009822 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:30.009798    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4eb431cf-be99-43e3-b7ff-5d1c2db9e027-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d\" (UID: \"4eb431cf-be99-43e3-b7ff-5d1c2db9e027\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d"
Sep 10 15:20:30.009899 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:30.009834    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4eb431cf-be99-43e3-b7ff-5d1c2db9e027-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d\" (UID: \"4eb431cf-be99-43e3-b7ff-5d1c2db9e027\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d"
Sep 10 15:20:30.029781 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:30.029712    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6x59\" (UniqueName: \"kubernetes.io/projected/4eb431cf-be99-43e3-b7ff-5d1c2db9e027-kube-api-access-v6x59\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d\" (UID: \"4eb431cf-be99-43e3-b7ff-5d1c2db9e027\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d"
Sep 10 15:20:30.081483 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:30.081445    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d"
Sep 10 15:20:30.355087 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:30.355064    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d"]
Sep 10 15:20:30.357673 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:20:30.357645    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eb431cf_be99_43e3_b7ff_5d1c2db9e027.slice/crio-95f4aec66cff022edfdd5429d9cd1fbeec0cb996ba4ffdb9b139bb883ed71385 WatchSource:0}: Error finding container 95f4aec66cff022edfdd5429d9cd1fbeec0cb996ba4ffdb9b139bb883ed71385: Status 404 returned error can't find the container with id 95f4aec66cff022edfdd5429d9cd1fbeec0cb996ba4ffdb9b139bb883ed71385
Sep 10 15:20:30.697525 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:30.697426    2574 generic.go:356] "Generic (PLEG): container finished" podID="4eb431cf-be99-43e3-b7ff-5d1c2db9e027" containerID="e10c50c0dcb45787c9b03d30b64682a2c5da212ae169f80c7db34349a0181934" exitCode=0
Sep 10 15:20:30.697525 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:30.697503    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d" event={"ID":"4eb431cf-be99-43e3-b7ff-5d1c2db9e027","Type":"ContainerDied","Data":"e10c50c0dcb45787c9b03d30b64682a2c5da212ae169f80c7db34349a0181934"}
Sep 10 15:20:30.697792 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:30.697580    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d" event={"ID":"4eb431cf-be99-43e3-b7ff-5d1c2db9e027","Type":"ContainerStarted","Data":"95f4aec66cff022edfdd5429d9cd1fbeec0cb996ba4ffdb9b139bb883ed71385"}
Sep 10 15:20:32.094021 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.093981    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"]
Sep 10 15:20:32.096682 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.096658    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"
Sep 10 15:20:32.099530 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.099498    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 15:20:32.099671 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.099535    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 15:20:32.099671 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.099563    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 15:20:32.099883 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.099856    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wbskq\""
Sep 10 15:20:32.099982 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.099917    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 15:20:32.115239 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.115213    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"]
Sep 10 15:20:32.128785 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.128758    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908-tmp\") pod \"opendatahub-operator-controller-manager-76f847f9cd-9rd5b\" (UID: \"f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908\") " pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"
Sep 10 15:20:32.128894 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.128805    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908-webhook-cert\") pod \"opendatahub-operator-controller-manager-76f847f9cd-9rd5b\" (UID: \"f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908\") " pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"
Sep 10 15:20:32.128965 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.128904    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76f847f9cd-9rd5b\" (UID: \"f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908\") " pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"
Sep 10 15:20:32.128965 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.128956    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw6pw\" (UniqueName: \"kubernetes.io/projected/f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908-kube-api-access-tw6pw\") pod \"opendatahub-operator-controller-manager-76f847f9cd-9rd5b\" (UID: \"f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908\") " pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"
Sep 10 15:20:32.129043 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.128988    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908-manifests\") pod \"opendatahub-operator-controller-manager-76f847f9cd-9rd5b\" (UID: \"f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908\") " pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"
Sep 10 15:20:32.229387 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.229349    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76f847f9cd-9rd5b\" (UID: \"f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908\") " pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"
Sep 10 15:20:32.229551 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.229398    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw6pw\" (UniqueName: \"kubernetes.io/projected/f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908-kube-api-access-tw6pw\") pod \"opendatahub-operator-controller-manager-76f847f9cd-9rd5b\" (UID: \"f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908\") " pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"
Sep 10 15:20:32.229551 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.229429    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908-manifests\") pod \"opendatahub-operator-controller-manager-76f847f9cd-9rd5b\" (UID: \"f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908\") " pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"
Sep 10 15:20:32.229551 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.229469    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908-tmp\") pod \"opendatahub-operator-controller-manager-76f847f9cd-9rd5b\" (UID: \"f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908\") " pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"
Sep 10 15:20:32.229551 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.229517    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908-webhook-cert\") pod \"opendatahub-operator-controller-manager-76f847f9cd-9rd5b\" (UID: \"f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908\") " pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"
Sep 10 15:20:32.230000 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.229967    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908-manifests\") pod \"opendatahub-operator-controller-manager-76f847f9cd-9rd5b\" (UID: \"f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908\") " pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"
Sep 10 15:20:32.231835 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.231814    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908-tmp\") pod \"opendatahub-operator-controller-manager-76f847f9cd-9rd5b\" (UID: \"f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908\") " pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"
Sep 10 15:20:32.232014 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.231997    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76f847f9cd-9rd5b\" (UID: \"f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908\") " pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"
Sep 10 15:20:32.232077 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.232063    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908-webhook-cert\") pod \"opendatahub-operator-controller-manager-76f847f9cd-9rd5b\" (UID: \"f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908\") " pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"
Sep 10 15:20:32.239234 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.239214    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw6pw\" (UniqueName: \"kubernetes.io/projected/f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908-kube-api-access-tw6pw\") pod \"opendatahub-operator-controller-manager-76f847f9cd-9rd5b\" (UID: \"f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908\") " pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"
Sep 10 15:20:32.406969 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.406865    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"
Sep 10 15:20:32.686108 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.685964    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"]
Sep 10 15:20:32.689036 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:20:32.689004    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4cc8a41_2f9b_4209_8a3b_dfb5ab4ed908.slice/crio-2de1c1be818ef4aad533e35538300dc1a729722a2a9af6ce0817a1692604d114 WatchSource:0}: Error finding container 2de1c1be818ef4aad533e35538300dc1a729722a2a9af6ce0817a1692604d114: Status 404 returned error can't find the container with id 2de1c1be818ef4aad533e35538300dc1a729722a2a9af6ce0817a1692604d114
Sep 10 15:20:32.708498 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.708473    2574 generic.go:356] "Generic (PLEG): container finished" podID="4eb431cf-be99-43e3-b7ff-5d1c2db9e027" containerID="ac818971975d04b4cf585dd88e13be0756e7ac78799644da6787aedc16318080" exitCode=0
Sep 10 15:20:32.708606 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.708547    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d" event={"ID":"4eb431cf-be99-43e3-b7ff-5d1c2db9e027","Type":"ContainerDied","Data":"ac818971975d04b4cf585dd88e13be0756e7ac78799644da6787aedc16318080"}
Sep 10 15:20:32.709879 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:32.709855    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b" event={"ID":"f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908","Type":"ContainerStarted","Data":"2de1c1be818ef4aad533e35538300dc1a729722a2a9af6ce0817a1692604d114"}
Sep 10 15:20:33.719680 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:33.719593    2574 generic.go:356] "Generic (PLEG): container finished" podID="4eb431cf-be99-43e3-b7ff-5d1c2db9e027" containerID="f742c5f9e4ba2cf28fb56905448c12f1e469530edb89d6e89dbb67eb05e4c6e5" exitCode=0
Sep 10 15:20:33.719680 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:33.719680    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d" event={"ID":"4eb431cf-be99-43e3-b7ff-5d1c2db9e027","Type":"ContainerDied","Data":"f742c5f9e4ba2cf28fb56905448c12f1e469530edb89d6e89dbb67eb05e4c6e5"}
Sep 10 15:20:35.107258 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:35.107229    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d"
Sep 10 15:20:35.151597 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:35.151520    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4eb431cf-be99-43e3-b7ff-5d1c2db9e027-util\") pod \"4eb431cf-be99-43e3-b7ff-5d1c2db9e027\" (UID: \"4eb431cf-be99-43e3-b7ff-5d1c2db9e027\") "
Sep 10 15:20:35.151597 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:35.151612    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6x59\" (UniqueName: \"kubernetes.io/projected/4eb431cf-be99-43e3-b7ff-5d1c2db9e027-kube-api-access-v6x59\") pod \"4eb431cf-be99-43e3-b7ff-5d1c2db9e027\" (UID: \"4eb431cf-be99-43e3-b7ff-5d1c2db9e027\") "
Sep 10 15:20:35.154734 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:35.154594    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eb431cf-be99-43e3-b7ff-5d1c2db9e027-kube-api-access-v6x59" (OuterVolumeSpecName: "kube-api-access-v6x59") pod "4eb431cf-be99-43e3-b7ff-5d1c2db9e027" (UID: "4eb431cf-be99-43e3-b7ff-5d1c2db9e027"). InnerVolumeSpecName "kube-api-access-v6x59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:20:35.158365 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:35.158337    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eb431cf-be99-43e3-b7ff-5d1c2db9e027-util" (OuterVolumeSpecName: "util") pod "4eb431cf-be99-43e3-b7ff-5d1c2db9e027" (UID: "4eb431cf-be99-43e3-b7ff-5d1c2db9e027"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:20:35.252583 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:35.252546    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4eb431cf-be99-43e3-b7ff-5d1c2db9e027-bundle\") pod \"4eb431cf-be99-43e3-b7ff-5d1c2db9e027\" (UID: \"4eb431cf-be99-43e3-b7ff-5d1c2db9e027\") "
Sep 10 15:20:35.252782 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:35.252767    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4eb431cf-be99-43e3-b7ff-5d1c2db9e027-util\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:20:35.252854 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:35.252789    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6x59\" (UniqueName: \"kubernetes.io/projected/4eb431cf-be99-43e3-b7ff-5d1c2db9e027-kube-api-access-v6x59\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:20:35.253454 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:35.253429    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eb431cf-be99-43e3-b7ff-5d1c2db9e027-bundle" (OuterVolumeSpecName: "bundle") pod "4eb431cf-be99-43e3-b7ff-5d1c2db9e027" (UID: "4eb431cf-be99-43e3-b7ff-5d1c2db9e027"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:20:35.354077 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:35.354003    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4eb431cf-be99-43e3-b7ff-5d1c2db9e027-bundle\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:20:35.733125 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:35.733046    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d" event={"ID":"4eb431cf-be99-43e3-b7ff-5d1c2db9e027","Type":"ContainerDied","Data":"95f4aec66cff022edfdd5429d9cd1fbeec0cb996ba4ffdb9b139bb883ed71385"}
Sep 10 15:20:35.733125 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:35.733116    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95f4aec66cff022edfdd5429d9cd1fbeec0cb996ba4ffdb9b139bb883ed71385"
Sep 10 15:20:35.733125 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:35.733065    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02858d"
Sep 10 15:20:36.740883 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:36.740845    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b" event={"ID":"f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908","Type":"ContainerStarted","Data":"e532b9ce357e63e7961eecc15072bb85209408a122357a67e09f3b2e7f9dbfcf"}
Sep 10 15:20:37.747185 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:37.747143    2574 generic.go:356] "Generic (PLEG): container finished" podID="f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908" containerID="e532b9ce357e63e7961eecc15072bb85209408a122357a67e09f3b2e7f9dbfcf" exitCode=0
Sep 10 15:20:37.747604 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:37.747232    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b" event={"ID":"f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908","Type":"ContainerDied","Data":"e532b9ce357e63e7961eecc15072bb85209408a122357a67e09f3b2e7f9dbfcf"}
Sep 10 15:20:38.754077 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:38.753987    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b" event={"ID":"f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908","Type":"ContainerStarted","Data":"393441e112609fd61f6a6c9c8eb69e485b0916117d83d500b646b712a432f3f1"}
Sep 10 15:20:38.754415 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:38.754084    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"
Sep 10 15:20:38.780846 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:38.780794    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b" podStartSLOduration=1.805336052 podStartE2EDuration="6.78078029s" totalImagesPullingTime="3.927877105s" totalInitContainerRuntime="1.047567133s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:20:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:20:38.777998275 +0000 UTC m=+291.827796783" watchObservedRunningTime="2026-09-10 15:20:38.78078029 +0000 UTC m=+291.830578854"
Sep 10 15:20:47.312465 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:47.312434    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/2.log"
Sep 10 15:20:47.312920 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:47.312528    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/2.log"
Sep 10 15:20:47.323718 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:47.323697    2574 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 15:20:49.762096 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:49.762059    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76f847f9cd-9rd5b"
Sep 10 15:20:50.225760 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.225719    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt"]
Sep 10 15:20:50.226126 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.226108    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eb431cf-be99-43e3-b7ff-5d1c2db9e027" containerName="util"
Sep 10 15:20:50.226220 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.226128    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eb431cf-be99-43e3-b7ff-5d1c2db9e027" containerName="util"
Sep 10 15:20:50.226220 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.226151    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eb431cf-be99-43e3-b7ff-5d1c2db9e027" containerName="extract"
Sep 10 15:20:50.226220 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.226160    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eb431cf-be99-43e3-b7ff-5d1c2db9e027" containerName="extract"
Sep 10 15:20:50.226220 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.226176    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eb431cf-be99-43e3-b7ff-5d1c2db9e027" containerName="pull"
Sep 10 15:20:50.226220 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.226185    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eb431cf-be99-43e3-b7ff-5d1c2db9e027" containerName="pull"
Sep 10 15:20:50.226465 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.226279    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eb431cf-be99-43e3-b7ff-5d1c2db9e027" containerName="extract"
Sep 10 15:20:50.229250 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.229230    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt"
Sep 10 15:20:50.232999 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.232976    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 10 15:20:50.233116 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.233057    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 15:20:50.233116 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.233051    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 10 15:20:50.233217 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.233141    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bfnmr\""
Sep 10 15:20:50.233303 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.233285    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 15:20:50.233487 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.233475    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 10 15:20:50.246343 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.246322    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt"]
Sep 10 15:20:50.269021 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.268998    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e07508ed-67e5-4ab4-9d09-6763cb5e77d0-manager-config\") pod \"lws-controller-manager-578d56c89f-crgmt\" (UID: \"e07508ed-67e5-4ab4-9d09-6763cb5e77d0\") " pod="openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt"
Sep 10 15:20:50.269156 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.269035    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e07508ed-67e5-4ab4-9d09-6763cb5e77d0-cert\") pod \"lws-controller-manager-578d56c89f-crgmt\" (UID: \"e07508ed-67e5-4ab4-9d09-6763cb5e77d0\") " pod="openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt"
Sep 10 15:20:50.269156 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.269073    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e07508ed-67e5-4ab4-9d09-6763cb5e77d0-metrics-cert\") pod \"lws-controller-manager-578d56c89f-crgmt\" (UID: \"e07508ed-67e5-4ab4-9d09-6763cb5e77d0\") " pod="openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt"
Sep 10 15:20:50.269156 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.269132    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdddm\" (UniqueName: \"kubernetes.io/projected/e07508ed-67e5-4ab4-9d09-6763cb5e77d0-kube-api-access-wdddm\") pod \"lws-controller-manager-578d56c89f-crgmt\" (UID: \"e07508ed-67e5-4ab4-9d09-6763cb5e77d0\") " pod="openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt"
Sep 10 15:20:50.370059 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.370016    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e07508ed-67e5-4ab4-9d09-6763cb5e77d0-metrics-cert\") pod \"lws-controller-manager-578d56c89f-crgmt\" (UID: \"e07508ed-67e5-4ab4-9d09-6763cb5e77d0\") " pod="openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt"
Sep 10 15:20:50.370059 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.370068    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdddm\" (UniqueName: \"kubernetes.io/projected/e07508ed-67e5-4ab4-9d09-6763cb5e77d0-kube-api-access-wdddm\") pod \"lws-controller-manager-578d56c89f-crgmt\" (UID: \"e07508ed-67e5-4ab4-9d09-6763cb5e77d0\") " pod="openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt"
Sep 10 15:20:50.370274 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.370119    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e07508ed-67e5-4ab4-9d09-6763cb5e77d0-manager-config\") pod \"lws-controller-manager-578d56c89f-crgmt\" (UID: \"e07508ed-67e5-4ab4-9d09-6763cb5e77d0\") " pod="openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt"
Sep 10 15:20:50.370274 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.370144    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e07508ed-67e5-4ab4-9d09-6763cb5e77d0-cert\") pod \"lws-controller-manager-578d56c89f-crgmt\" (UID: \"e07508ed-67e5-4ab4-9d09-6763cb5e77d0\") " pod="openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt"
Sep 10 15:20:50.370856 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.370827    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e07508ed-67e5-4ab4-9d09-6763cb5e77d0-manager-config\") pod \"lws-controller-manager-578d56c89f-crgmt\" (UID: \"e07508ed-67e5-4ab4-9d09-6763cb5e77d0\") " pod="openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt"
Sep 10 15:20:50.372567 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.372539    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e07508ed-67e5-4ab4-9d09-6763cb5e77d0-metrics-cert\") pod \"lws-controller-manager-578d56c89f-crgmt\" (UID: \"e07508ed-67e5-4ab4-9d09-6763cb5e77d0\") " pod="openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt"
Sep 10 15:20:50.372677 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.372570    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e07508ed-67e5-4ab4-9d09-6763cb5e77d0-cert\") pod \"lws-controller-manager-578d56c89f-crgmt\" (UID: \"e07508ed-67e5-4ab4-9d09-6763cb5e77d0\") " pod="openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt"
Sep 10 15:20:50.384199 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.384173    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdddm\" (UniqueName: \"kubernetes.io/projected/e07508ed-67e5-4ab4-9d09-6763cb5e77d0-kube-api-access-wdddm\") pod \"lws-controller-manager-578d56c89f-crgmt\" (UID: \"e07508ed-67e5-4ab4-9d09-6763cb5e77d0\") " pod="openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt"
Sep 10 15:20:50.538600 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.538511    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt"
Sep 10 15:20:50.814380 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.814354    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt"]
Sep 10 15:20:50.816266 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:20:50.816239    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode07508ed_67e5_4ab4_9d09_6763cb5e77d0.slice/crio-54cd205af1576dd2c7d4444d4b170c2bd524094b38313b445545fc852accc2a2 WatchSource:0}: Error finding container 54cd205af1576dd2c7d4444d4b170c2bd524094b38313b445545fc852accc2a2: Status 404 returned error can't find the container with id 54cd205af1576dd2c7d4444d4b170c2bd524094b38313b445545fc852accc2a2
Sep 10 15:20:50.818182 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:50.818162    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 15:20:51.818249 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:51.818199    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt" event={"ID":"e07508ed-67e5-4ab4-9d09-6763cb5e77d0","Type":"ContainerStarted","Data":"54cd205af1576dd2c7d4444d4b170c2bd524094b38313b445545fc852accc2a2"}
Sep 10 15:20:52.824408 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:52.824371    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt" event={"ID":"e07508ed-67e5-4ab4-9d09-6763cb5e77d0","Type":"ContainerStarted","Data":"64a49132ecc091c98d1b1206c58124b0e7897625c6a1faf851c057e6630925a1"}
Sep 10 15:20:52.824815 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:52.824522    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt"
Sep 10 15:20:52.856020 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:52.855967    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt" podStartSLOduration=1.318726335 podStartE2EDuration="2.85592068s" totalImagesPullingTime="1.537194345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:20:52.855131765 +0000 UTC m=+305.904930273" watchObservedRunningTime="2026-09-10 15:20:52.85592068 +0000 UTC m=+305.905719187"
Sep 10 15:20:58.782218 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.782183    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"]
Sep 10 15:20:58.785793 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.785769    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.788867 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.788843    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-x47xd\""
Sep 10 15:20:58.789084 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.789071    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 15:20:58.799518 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.799491    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"]
Sep 10 15:20:58.851450 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.851420    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/676f81af-2194-425d-b987-dbcab10f6a5a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.851450 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.851459    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/676f81af-2194-425d-b987-dbcab10f6a5a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.851672 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.851489    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/676f81af-2194-425d-b987-dbcab10f6a5a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.851672 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.851576    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/676f81af-2194-425d-b987-dbcab10f6a5a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.851672 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.851615    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/676f81af-2194-425d-b987-dbcab10f6a5a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.851672 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.851642    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb49t\" (UniqueName: \"kubernetes.io/projected/676f81af-2194-425d-b987-dbcab10f6a5a-kube-api-access-wb49t\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.851805 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.851676    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/676f81af-2194-425d-b987-dbcab10f6a5a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.851805 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.851703    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/676f81af-2194-425d-b987-dbcab10f6a5a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.851805 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.851740    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/676f81af-2194-425d-b987-dbcab10f6a5a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.952290 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.952254    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/676f81af-2194-425d-b987-dbcab10f6a5a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.952472 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.952299    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/676f81af-2194-425d-b987-dbcab10f6a5a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.952472 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.952331    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb49t\" (UniqueName: \"kubernetes.io/projected/676f81af-2194-425d-b987-dbcab10f6a5a-kube-api-access-wb49t\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.952560 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.952507    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/676f81af-2194-425d-b987-dbcab10f6a5a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.952601 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.952560    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/676f81af-2194-425d-b987-dbcab10f6a5a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.952642 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.952609    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/676f81af-2194-425d-b987-dbcab10f6a5a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.952702 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.952685    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/676f81af-2194-425d-b987-dbcab10f6a5a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.952751 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.952718    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/676f81af-2194-425d-b987-dbcab10f6a5a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.952806 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.952749    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/676f81af-2194-425d-b987-dbcab10f6a5a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.952806 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.952755    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/676f81af-2194-425d-b987-dbcab10f6a5a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.952982 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.952959    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/676f81af-2194-425d-b987-dbcab10f6a5a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.953160 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.953138    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/676f81af-2194-425d-b987-dbcab10f6a5a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.953237 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.953168    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/676f81af-2194-425d-b987-dbcab10f6a5a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.953237 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.953200    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/676f81af-2194-425d-b987-dbcab10f6a5a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.954761 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.954740    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/676f81af-2194-425d-b987-dbcab10f6a5a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.955283 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.955262    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/676f81af-2194-425d-b987-dbcab10f6a5a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.963656 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.963634    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/676f81af-2194-425d-b987-dbcab10f6a5a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:58.965062 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:58.965044    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb49t\" (UniqueName: \"kubernetes.io/projected/676f81af-2194-425d-b987-dbcab10f6a5a-kube-api-access-wb49t\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg\" (UID: \"676f81af-2194-425d-b987-dbcab10f6a5a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:59.096141 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:59.096103    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:20:59.374601 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:59.374576    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"]
Sep 10 15:20:59.376797 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:20:59.376756    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod676f81af_2194_425d_b987_dbcab10f6a5a.slice/crio-904236e13a13b2bb10742870269bcc00e792b64344694d2e6d86af577137e887 WatchSource:0}: Error finding container 904236e13a13b2bb10742870269bcc00e792b64344694d2e6d86af577137e887: Status 404 returned error can't find the container with id 904236e13a13b2bb10742870269bcc00e792b64344694d2e6d86af577137e887
Sep 10 15:20:59.861688 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:20:59.861652    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg" event={"ID":"676f81af-2194-425d-b987-dbcab10f6a5a","Type":"ContainerStarted","Data":"904236e13a13b2bb10742870269bcc00e792b64344694d2e6d86af577137e887"}
Sep 10 15:21:02.168790 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:02.168751    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:21:02.169089 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:02.168821    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:21:02.169089 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:02.168850    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:21:02.879487 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:02.879454    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-t9f98"]
Sep 10 15:21:02.882621 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:02.882598    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg" event={"ID":"676f81af-2194-425d-b987-dbcab10f6a5a","Type":"ContainerStarted","Data":"5a75c4484a3f3c4dca3fcace5bf5d8e93fe72e52b1ca9baddc40bd6dbc0f987a"}
Sep 10 15:21:02.882724 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:02.882682    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-t9f98"
Sep 10 15:21:02.886060 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:02.886039    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-dcb92\""
Sep 10 15:21:02.886152 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:02.886062    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 10 15:21:02.894176 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:02.894149    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-t9f98"]
Sep 10 15:21:02.910187 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:02.910139    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg" podStartSLOduration=2.120561904 podStartE2EDuration="4.910125331s" totalImagesPullingTime="2.789563427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:20:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:21:02.908570908 +0000 UTC m=+315.958369418" watchObservedRunningTime="2026-09-10 15:21:02.910125331 +0000 UTC m=+315.959923838"
Sep 10 15:21:02.992872 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:02.992832    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27d0d1c2-129d-4246-81a5-f38e3377b5a8-cert\") pod \"odh-model-controller-7998c67dc4-t9f98\" (UID: \"27d0d1c2-129d-4246-81a5-f38e3377b5a8\") " pod="opendatahub/odh-model-controller-7998c67dc4-t9f98"
Sep 10 15:21:02.993096 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:02.992961    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wnw8\" (UniqueName: \"kubernetes.io/projected/27d0d1c2-129d-4246-81a5-f38e3377b5a8-kube-api-access-6wnw8\") pod \"odh-model-controller-7998c67dc4-t9f98\" (UID: \"27d0d1c2-129d-4246-81a5-f38e3377b5a8\") " pod="opendatahub/odh-model-controller-7998c67dc4-t9f98"
Sep 10 15:21:03.094032 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.093993    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wnw8\" (UniqueName: \"kubernetes.io/projected/27d0d1c2-129d-4246-81a5-f38e3377b5a8-kube-api-access-6wnw8\") pod \"odh-model-controller-7998c67dc4-t9f98\" (UID: \"27d0d1c2-129d-4246-81a5-f38e3377b5a8\") " pod="opendatahub/odh-model-controller-7998c67dc4-t9f98"
Sep 10 15:21:03.094200 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.094079    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27d0d1c2-129d-4246-81a5-f38e3377b5a8-cert\") pod \"odh-model-controller-7998c67dc4-t9f98\" (UID: \"27d0d1c2-129d-4246-81a5-f38e3377b5a8\") " pod="opendatahub/odh-model-controller-7998c67dc4-t9f98"
Sep 10 15:21:03.094200 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:21:03.094188    2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 10 15:21:03.094282 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:21:03.094248    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d0d1c2-129d-4246-81a5-f38e3377b5a8-cert podName:27d0d1c2-129d-4246-81a5-f38e3377b5a8 nodeName:}" failed. No retries permitted until 2026-09-10 15:21:03.594231877 +0000 UTC m=+316.644030363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/27d0d1c2-129d-4246-81a5-f38e3377b5a8-cert") pod "odh-model-controller-7998c67dc4-t9f98" (UID: "27d0d1c2-129d-4246-81a5-f38e3377b5a8") : secret "odh-model-controller-webhook-cert" not found
Sep 10 15:21:03.096914 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.096881    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:21:03.101317 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.101297    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:21:03.103035 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.103018    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wnw8\" (UniqueName: \"kubernetes.io/projected/27d0d1c2-129d-4246-81a5-f38e3377b5a8-kube-api-access-6wnw8\") pod \"odh-model-controller-7998c67dc4-t9f98\" (UID: \"27d0d1c2-129d-4246-81a5-f38e3377b5a8\") " pod="opendatahub/odh-model-controller-7998c67dc4-t9f98"
Sep 10 15:21:03.415389 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.415360    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jgwbd"]
Sep 10 15:21:03.418673 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.418656    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jgwbd"
Sep 10 15:21:03.422850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.422823    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 10 15:21:03.431184 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.431161    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jgwbd"]
Sep 10 15:21:03.497452 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.497418    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d5af6be-c91c-460a-803a-99244d7a809b-tls-certs\") pod \"model-serving-api-54d89bd5fc-jgwbd\" (UID: \"2d5af6be-c91c-460a-803a-99244d7a809b\") " pod="opendatahub/model-serving-api-54d89bd5fc-jgwbd"
Sep 10 15:21:03.497452 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.497451    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9vp6\" (UniqueName: \"kubernetes.io/projected/2d5af6be-c91c-460a-803a-99244d7a809b-kube-api-access-s9vp6\") pod \"model-serving-api-54d89bd5fc-jgwbd\" (UID: \"2d5af6be-c91c-460a-803a-99244d7a809b\") " pod="opendatahub/model-serving-api-54d89bd5fc-jgwbd"
Sep 10 15:21:03.598227 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.598197    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27d0d1c2-129d-4246-81a5-f38e3377b5a8-cert\") pod \"odh-model-controller-7998c67dc4-t9f98\" (UID: \"27d0d1c2-129d-4246-81a5-f38e3377b5a8\") " pod="opendatahub/odh-model-controller-7998c67dc4-t9f98"
Sep 10 15:21:03.598399 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.598285    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d5af6be-c91c-460a-803a-99244d7a809b-tls-certs\") pod \"model-serving-api-54d89bd5fc-jgwbd\" (UID: \"2d5af6be-c91c-460a-803a-99244d7a809b\") " pod="opendatahub/model-serving-api-54d89bd5fc-jgwbd"
Sep 10 15:21:03.598399 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.598308    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9vp6\" (UniqueName: \"kubernetes.io/projected/2d5af6be-c91c-460a-803a-99244d7a809b-kube-api-access-s9vp6\") pod \"model-serving-api-54d89bd5fc-jgwbd\" (UID: \"2d5af6be-c91c-460a-803a-99244d7a809b\") " pod="opendatahub/model-serving-api-54d89bd5fc-jgwbd"
Sep 10 15:21:03.600434 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.600410    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27d0d1c2-129d-4246-81a5-f38e3377b5a8-cert\") pod \"odh-model-controller-7998c67dc4-t9f98\" (UID: \"27d0d1c2-129d-4246-81a5-f38e3377b5a8\") " pod="opendatahub/odh-model-controller-7998c67dc4-t9f98"
Sep 10 15:21:03.600620 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.600599    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d5af6be-c91c-460a-803a-99244d7a809b-tls-certs\") pod \"model-serving-api-54d89bd5fc-jgwbd\" (UID: \"2d5af6be-c91c-460a-803a-99244d7a809b\") " pod="opendatahub/model-serving-api-54d89bd5fc-jgwbd"
Sep 10 15:21:03.609560 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.609532    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9vp6\" (UniqueName: \"kubernetes.io/projected/2d5af6be-c91c-460a-803a-99244d7a809b-kube-api-access-s9vp6\") pod \"model-serving-api-54d89bd5fc-jgwbd\" (UID: \"2d5af6be-c91c-460a-803a-99244d7a809b\") " pod="opendatahub/model-serving-api-54d89bd5fc-jgwbd"
Sep 10 15:21:03.729922 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.729836    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jgwbd"
Sep 10 15:21:03.793452 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.793240    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-t9f98"
Sep 10 15:21:03.833697 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.833662    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-578d56c89f-crgmt"
Sep 10 15:21:03.885663 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.885630    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:21:03.886645 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:03.886616    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg"
Sep 10 15:21:04.005119 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:04.005098    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jgwbd"]
Sep 10 15:21:04.006803 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:21:04.006780    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d5af6be_c91c_460a_803a_99244d7a809b.slice/crio-a813f397f48c6f6fc86da3647183e0f1cd0858b3c5cc40d2aaccd9700fb963ab WatchSource:0}: Error finding container a813f397f48c6f6fc86da3647183e0f1cd0858b3c5cc40d2aaccd9700fb963ab: Status 404 returned error can't find the container with id a813f397f48c6f6fc86da3647183e0f1cd0858b3c5cc40d2aaccd9700fb963ab
Sep 10 15:21:04.068509 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:04.068484    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-t9f98"]
Sep 10 15:21:04.070795 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:21:04.070773    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d0d1c2_129d_4246_81a5_f38e3377b5a8.slice/crio-d0b5a1a6b2ea49c9989685d66b50cdbc290b4d7586f0dd922c44ee3453d3e421 WatchSource:0}: Error finding container d0b5a1a6b2ea49c9989685d66b50cdbc290b4d7586f0dd922c44ee3453d3e421: Status 404 returned error can't find the container with id d0b5a1a6b2ea49c9989685d66b50cdbc290b4d7586f0dd922c44ee3453d3e421
Sep 10 15:21:04.896222 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:04.896185    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-t9f98" event={"ID":"27d0d1c2-129d-4246-81a5-f38e3377b5a8","Type":"ContainerStarted","Data":"d0b5a1a6b2ea49c9989685d66b50cdbc290b4d7586f0dd922c44ee3453d3e421"}
Sep 10 15:21:04.898947 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:04.898895    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jgwbd" event={"ID":"2d5af6be-c91c-460a-803a-99244d7a809b","Type":"ContainerStarted","Data":"a813f397f48c6f6fc86da3647183e0f1cd0858b3c5cc40d2aaccd9700fb963ab"}
Sep 10 15:21:08.921659 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:08.921619    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-t9f98" event={"ID":"27d0d1c2-129d-4246-81a5-f38e3377b5a8","Type":"ContainerStarted","Data":"b34d18fd1d86b7b5ad1f4d7e5758fb73c78a5d93157f143b916efa6151dad0bf"}
Sep 10 15:21:08.922146 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:08.921845    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-t9f98"
Sep 10 15:21:08.923198 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:08.923174    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jgwbd" event={"ID":"2d5af6be-c91c-460a-803a-99244d7a809b","Type":"ContainerStarted","Data":"b471f2e57708e2180d128d3df2b680f43a7bb27450a2762d368ebf6cfe720f51"}
Sep 10 15:21:08.923308 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:08.923297    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-jgwbd"
Sep 10 15:21:08.945370 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:08.945315    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-t9f98" podStartSLOduration=2.834648277 podStartE2EDuration="6.945300017s" totalImagesPullingTime="4.11065174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:21:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:21:08.944104661 +0000 UTC m=+321.993903169" watchObservedRunningTime="2026-09-10 15:21:08.945300017 +0000 UTC m=+321.995098562"
Sep 10 15:21:08.981317 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:08.981266    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-jgwbd" podStartSLOduration=2.027101757 podStartE2EDuration="5.981249406s" totalImagesPullingTime="3.954147649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:21:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:21:08.981188723 +0000 UTC m=+322.030987231" watchObservedRunningTime="2026-09-10 15:21:08.981249406 +0000 UTC m=+322.031047914"
Sep 10 15:21:09.772990 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.772956    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"]
Sep 10 15:21:09.775237 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.775221    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:09.778293 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.778245    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 15:21:09.778466 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.778444    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 15:21:09.778578 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.778518    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 15:21:09.778797 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.778781    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-d5vrh\""
Sep 10 15:21:09.791764 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.791712    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"]
Sep 10 15:21:09.862500 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.862464    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/120fee7d-369b-4394-bd2d-bd8c87117822-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-9d2lk\" (UID: \"120fee7d-369b-4394-bd2d-bd8c87117822\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:09.862691 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.862514    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jj49\" (UniqueName: \"kubernetes.io/projected/120fee7d-369b-4394-bd2d-bd8c87117822-kube-api-access-4jj49\") pod \"istiod-openshift-gateway-5677ccb49b-9d2lk\" (UID: \"120fee7d-369b-4394-bd2d-bd8c87117822\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:09.862691 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.862593    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/120fee7d-369b-4394-bd2d-bd8c87117822-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-9d2lk\" (UID: \"120fee7d-369b-4394-bd2d-bd8c87117822\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:09.862810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.862702    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/120fee7d-369b-4394-bd2d-bd8c87117822-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-9d2lk\" (UID: \"120fee7d-369b-4394-bd2d-bd8c87117822\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:09.862810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.862753    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/120fee7d-369b-4394-bd2d-bd8c87117822-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-9d2lk\" (UID: \"120fee7d-369b-4394-bd2d-bd8c87117822\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:09.862916 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.862822    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/120fee7d-369b-4394-bd2d-bd8c87117822-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-9d2lk\" (UID: \"120fee7d-369b-4394-bd2d-bd8c87117822\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:09.862916 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.862853    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/120fee7d-369b-4394-bd2d-bd8c87117822-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-9d2lk\" (UID: \"120fee7d-369b-4394-bd2d-bd8c87117822\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:09.963735 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.963699    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/120fee7d-369b-4394-bd2d-bd8c87117822-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-9d2lk\" (UID: \"120fee7d-369b-4394-bd2d-bd8c87117822\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:09.963735 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.963734    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jj49\" (UniqueName: \"kubernetes.io/projected/120fee7d-369b-4394-bd2d-bd8c87117822-kube-api-access-4jj49\") pod \"istiod-openshift-gateway-5677ccb49b-9d2lk\" (UID: \"120fee7d-369b-4394-bd2d-bd8c87117822\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:09.964311 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.963765    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/120fee7d-369b-4394-bd2d-bd8c87117822-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-9d2lk\" (UID: \"120fee7d-369b-4394-bd2d-bd8c87117822\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:09.964311 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.963819    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/120fee7d-369b-4394-bd2d-bd8c87117822-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-9d2lk\" (UID: \"120fee7d-369b-4394-bd2d-bd8c87117822\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:09.964311 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.963848    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/120fee7d-369b-4394-bd2d-bd8c87117822-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-9d2lk\" (UID: \"120fee7d-369b-4394-bd2d-bd8c87117822\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:09.964311 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.963899    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/120fee7d-369b-4394-bd2d-bd8c87117822-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-9d2lk\" (UID: \"120fee7d-369b-4394-bd2d-bd8c87117822\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:09.964311 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.963925    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/120fee7d-369b-4394-bd2d-bd8c87117822-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-9d2lk\" (UID: \"120fee7d-369b-4394-bd2d-bd8c87117822\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:09.964797 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.964765    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/120fee7d-369b-4394-bd2d-bd8c87117822-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-9d2lk\" (UID: \"120fee7d-369b-4394-bd2d-bd8c87117822\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:09.966323 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.966295    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/120fee7d-369b-4394-bd2d-bd8c87117822-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-9d2lk\" (UID: \"120fee7d-369b-4394-bd2d-bd8c87117822\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:09.966428 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.966295    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/120fee7d-369b-4394-bd2d-bd8c87117822-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-9d2lk\" (UID: \"120fee7d-369b-4394-bd2d-bd8c87117822\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:09.966589 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.966568    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/120fee7d-369b-4394-bd2d-bd8c87117822-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-9d2lk\" (UID: \"120fee7d-369b-4394-bd2d-bd8c87117822\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:09.966628 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.966568    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/120fee7d-369b-4394-bd2d-bd8c87117822-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-9d2lk\" (UID: \"120fee7d-369b-4394-bd2d-bd8c87117822\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:09.972587 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.972561    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/120fee7d-369b-4394-bd2d-bd8c87117822-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-9d2lk\" (UID: \"120fee7d-369b-4394-bd2d-bd8c87117822\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:09.973180 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:09.973150    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jj49\" (UniqueName: \"kubernetes.io/projected/120fee7d-369b-4394-bd2d-bd8c87117822-kube-api-access-4jj49\") pod \"istiod-openshift-gateway-5677ccb49b-9d2lk\" (UID: \"120fee7d-369b-4394-bd2d-bd8c87117822\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:10.085180 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:10.085145    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:10.360522 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:10.360445    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"]
Sep 10 15:21:10.363642 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:21:10.363602    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod120fee7d_369b_4394_bd2d_bd8c87117822.slice/crio-ab26f8168d88be76db6aeb9d1e792b9deee8aeb62fb7683a6781033e1d02d6a3 WatchSource:0}: Error finding container ab26f8168d88be76db6aeb9d1e792b9deee8aeb62fb7683a6781033e1d02d6a3: Status 404 returned error can't find the container with id ab26f8168d88be76db6aeb9d1e792b9deee8aeb62fb7683a6781033e1d02d6a3
Sep 10 15:21:10.934139 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:10.934103    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk" event={"ID":"120fee7d-369b-4394-bd2d-bd8c87117822","Type":"ContainerStarted","Data":"ab26f8168d88be76db6aeb9d1e792b9deee8aeb62fb7683a6781033e1d02d6a3"}
Sep 10 15:21:12.901497 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:12.901463    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:21:12.901769 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:12.901527    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:21:13.950888 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:13.950848    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk" event={"ID":"120fee7d-369b-4394-bd2d-bd8c87117822","Type":"ContainerStarted","Data":"254871d6b7b0c81974f41ed62d146415648806d3a05309ca13a788bd0f8dd2ec"}
Sep 10 15:21:13.951324 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:13.951033    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:13.953076 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:13.953052    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-9d2lk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 15:21:13.953224 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:13.953097    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk" podUID="120fee7d-369b-4394-bd2d-bd8c87117822" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 15:21:13.979589 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:13.979538    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk" podStartSLOduration=2.443902129 podStartE2EDuration="4.979523494s" totalImagesPullingTime="2.535621365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:21:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:21:13.977106391 +0000 UTC m=+327.026904902" watchObservedRunningTime="2026-09-10 15:21:13.979523494 +0000 UTC m=+327.029322001"
Sep 10 15:21:14.956749 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:14.956722    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9d2lk"
Sep 10 15:21:19.930802 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:19.930769    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-t9f98"
Sep 10 15:21:19.932469 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:21:19.932448    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-jgwbd"
Sep 10 15:22:07.863161 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:07.863077    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc"]
Sep 10 15:22:07.877918 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:07.877880    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc"]
Sep 10 15:22:07.878112 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:07.878023    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc"
Sep 10 15:22:07.880863 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:07.880837    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 15:22:07.882068 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:07.882045    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zcmdn\""
Sep 10 15:22:07.882190 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:07.882077    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 15:22:07.958148 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:07.958113    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g9vk\" (UniqueName: \"kubernetes.io/projected/63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd-kube-api-access-4g9vk\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc\" (UID: \"63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc"
Sep 10 15:22:07.958336 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:07.958192    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc\" (UID: \"63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc"
Sep 10 15:22:07.958336 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:07.958258    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc\" (UID: \"63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc"
Sep 10 15:22:07.963699 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:07.963667    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw"]
Sep 10 15:22:07.966636 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:07.966618    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw"
Sep 10 15:22:07.977663 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:07.977640    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw"]
Sep 10 15:22:08.059383 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.059346    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bec4378d-18cc-4cec-934d-976d0b8787ce-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw\" (UID: \"bec4378d-18cc-4cec-934d-976d0b8787ce\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw"
Sep 10 15:22:08.059590 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.059400    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bec4378d-18cc-4cec-934d-976d0b8787ce-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw\" (UID: \"bec4378d-18cc-4cec-934d-976d0b8787ce\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw"
Sep 10 15:22:08.059590 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.059423    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc\" (UID: \"63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc"
Sep 10 15:22:08.059590 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.059458    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g9vk\" (UniqueName: \"kubernetes.io/projected/63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd-kube-api-access-4g9vk\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc\" (UID: \"63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc"
Sep 10 15:22:08.059590 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.059483    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrk8g\" (UniqueName: \"kubernetes.io/projected/bec4378d-18cc-4cec-934d-976d0b8787ce-kube-api-access-nrk8g\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw\" (UID: \"bec4378d-18cc-4cec-934d-976d0b8787ce\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw"
Sep 10 15:22:08.059590 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.059531    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc\" (UID: \"63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc"
Sep 10 15:22:08.059835 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.059762    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc\" (UID: \"63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc"
Sep 10 15:22:08.059875 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.059833    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc\" (UID: \"63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc"
Sep 10 15:22:08.067659 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.067633    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8"]
Sep 10 15:22:08.070283 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.070256    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8"
Sep 10 15:22:08.070476 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.070453    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g9vk\" (UniqueName: \"kubernetes.io/projected/63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd-kube-api-access-4g9vk\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc\" (UID: \"63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc"
Sep 10 15:22:08.080185 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.080165    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8"]
Sep 10 15:22:08.160611 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.160527    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrk8g\" (UniqueName: \"kubernetes.io/projected/bec4378d-18cc-4cec-934d-976d0b8787ce-kube-api-access-nrk8g\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw\" (UID: \"bec4378d-18cc-4cec-934d-976d0b8787ce\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw"
Sep 10 15:22:08.160611 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.160601    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f943eafd-d9de-4baa-b9d7-dbe0eb05e294-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8\" (UID: \"f943eafd-d9de-4baa-b9d7-dbe0eb05e294\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8"
Sep 10 15:22:08.160823 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.160699    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f943eafd-d9de-4baa-b9d7-dbe0eb05e294-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8\" (UID: \"f943eafd-d9de-4baa-b9d7-dbe0eb05e294\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8"
Sep 10 15:22:08.160823 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.160753    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bec4378d-18cc-4cec-934d-976d0b8787ce-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw\" (UID: \"bec4378d-18cc-4cec-934d-976d0b8787ce\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw"
Sep 10 15:22:08.160823 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.160796    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxk88\" (UniqueName: \"kubernetes.io/projected/f943eafd-d9de-4baa-b9d7-dbe0eb05e294-kube-api-access-dxk88\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8\" (UID: \"f943eafd-d9de-4baa-b9d7-dbe0eb05e294\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8"
Sep 10 15:22:08.161022 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.160842    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bec4378d-18cc-4cec-934d-976d0b8787ce-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw\" (UID: \"bec4378d-18cc-4cec-934d-976d0b8787ce\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw"
Sep 10 15:22:08.161217 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.161200    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bec4378d-18cc-4cec-934d-976d0b8787ce-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw\" (UID: \"bec4378d-18cc-4cec-934d-976d0b8787ce\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw"
Sep 10 15:22:08.161254 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.161227    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bec4378d-18cc-4cec-934d-976d0b8787ce-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw\" (UID: \"bec4378d-18cc-4cec-934d-976d0b8787ce\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw"
Sep 10 15:22:08.170431 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.170410    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq"]
Sep 10 15:22:08.172308 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.172284    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrk8g\" (UniqueName: \"kubernetes.io/projected/bec4378d-18cc-4cec-934d-976d0b8787ce-kube-api-access-nrk8g\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw\" (UID: \"bec4378d-18cc-4cec-934d-976d0b8787ce\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw"
Sep 10 15:22:08.173058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.173044    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq"
Sep 10 15:22:08.183374 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.183350    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq"]
Sep 10 15:22:08.188902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.188884    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc"
Sep 10 15:22:08.261905 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.261872    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d018a782-f9e0-4da1-be09-dbc58d8167ea-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq\" (UID: \"d018a782-f9e0-4da1-be09-dbc58d8167ea\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq"
Sep 10 15:22:08.262090 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.261953    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp6cc\" (UniqueName: \"kubernetes.io/projected/d018a782-f9e0-4da1-be09-dbc58d8167ea-kube-api-access-sp6cc\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq\" (UID: \"d018a782-f9e0-4da1-be09-dbc58d8167ea\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq"
Sep 10 15:22:08.262090 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.261989    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f943eafd-d9de-4baa-b9d7-dbe0eb05e294-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8\" (UID: \"f943eafd-d9de-4baa-b9d7-dbe0eb05e294\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8"
Sep 10 15:22:08.262090 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.262010    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d018a782-f9e0-4da1-be09-dbc58d8167ea-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq\" (UID: \"d018a782-f9e0-4da1-be09-dbc58d8167ea\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq"
Sep 10 15:22:08.262090 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.262071    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f943eafd-d9de-4baa-b9d7-dbe0eb05e294-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8\" (UID: \"f943eafd-d9de-4baa-b9d7-dbe0eb05e294\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8"
Sep 10 15:22:08.262301 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.262129    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxk88\" (UniqueName: \"kubernetes.io/projected/f943eafd-d9de-4baa-b9d7-dbe0eb05e294-kube-api-access-dxk88\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8\" (UID: \"f943eafd-d9de-4baa-b9d7-dbe0eb05e294\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8"
Sep 10 15:22:08.262790 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.262714    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f943eafd-d9de-4baa-b9d7-dbe0eb05e294-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8\" (UID: \"f943eafd-d9de-4baa-b9d7-dbe0eb05e294\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8"
Sep 10 15:22:08.262790 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.262786    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f943eafd-d9de-4baa-b9d7-dbe0eb05e294-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8\" (UID: \"f943eafd-d9de-4baa-b9d7-dbe0eb05e294\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8"
Sep 10 15:22:08.271909 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.271875    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxk88\" (UniqueName: \"kubernetes.io/projected/f943eafd-d9de-4baa-b9d7-dbe0eb05e294-kube-api-access-dxk88\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8\" (UID: \"f943eafd-d9de-4baa-b9d7-dbe0eb05e294\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8"
Sep 10 15:22:08.276660 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.276641    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw"
Sep 10 15:22:08.363380 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.363347    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d018a782-f9e0-4da1-be09-dbc58d8167ea-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq\" (UID: \"d018a782-f9e0-4da1-be09-dbc58d8167ea\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq"
Sep 10 15:22:08.363555 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.363401    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp6cc\" (UniqueName: \"kubernetes.io/projected/d018a782-f9e0-4da1-be09-dbc58d8167ea-kube-api-access-sp6cc\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq\" (UID: \"d018a782-f9e0-4da1-be09-dbc58d8167ea\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq"
Sep 10 15:22:08.363555 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.363437    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d018a782-f9e0-4da1-be09-dbc58d8167ea-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq\" (UID: \"d018a782-f9e0-4da1-be09-dbc58d8167ea\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq"
Sep 10 15:22:08.363777 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.363755    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d018a782-f9e0-4da1-be09-dbc58d8167ea-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq\" (UID: \"d018a782-f9e0-4da1-be09-dbc58d8167ea\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq"
Sep 10 15:22:08.363840 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.363784    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d018a782-f9e0-4da1-be09-dbc58d8167ea-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq\" (UID: \"d018a782-f9e0-4da1-be09-dbc58d8167ea\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq"
Sep 10 15:22:08.374680 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.374656    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp6cc\" (UniqueName: \"kubernetes.io/projected/d018a782-f9e0-4da1-be09-dbc58d8167ea-kube-api-access-sp6cc\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq\" (UID: \"d018a782-f9e0-4da1-be09-dbc58d8167ea\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq"
Sep 10 15:22:08.387511 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.387485    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8"
Sep 10 15:22:08.468346 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.468316    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc"]
Sep 10 15:22:08.468731 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:22:08.468709    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c65bb6_971c_4f1f_bbf2_ba48ba4dfcdd.slice/crio-ddc7fe534b1c1ca6a660cab8a6f6cb98451dd4e5422d16f9f24d231d7f2f2bfd WatchSource:0}: Error finding container ddc7fe534b1c1ca6a660cab8a6f6cb98451dd4e5422d16f9f24d231d7f2f2bfd: Status 404 returned error can't find the container with id ddc7fe534b1c1ca6a660cab8a6f6cb98451dd4e5422d16f9f24d231d7f2f2bfd
Sep 10 15:22:08.488208 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.488181    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq"
Sep 10 15:22:08.554133 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.554107    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw"]
Sep 10 15:22:08.557167 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:22:08.557140    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbec4378d_18cc_4cec_934d_976d0b8787ce.slice/crio-3bc4f8d99b30c45088b1b8b28ade731189bccdc54469f598f91b3399429a1aa0 WatchSource:0}: Error finding container 3bc4f8d99b30c45088b1b8b28ade731189bccdc54469f598f91b3399429a1aa0: Status 404 returned error can't find the container with id 3bc4f8d99b30c45088b1b8b28ade731189bccdc54469f598f91b3399429a1aa0
Sep 10 15:22:08.662426 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.662387    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8"]
Sep 10 15:22:08.666289 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:22:08.665557    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf943eafd_d9de_4baa_b9d7_dbe0eb05e294.slice/crio-bd62485286dd6343fe41063d9c5c3ddd0ce66dc49b874101bba65d60e46d47f1 WatchSource:0}: Error finding container bd62485286dd6343fe41063d9c5c3ddd0ce66dc49b874101bba65d60e46d47f1: Status 404 returned error can't find the container with id bd62485286dd6343fe41063d9c5c3ddd0ce66dc49b874101bba65d60e46d47f1
Sep 10 15:22:08.784887 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:08.784863    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq"]
Sep 10 15:22:08.786863 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:22:08.786832    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd018a782_f9e0_4da1_be09_dbc58d8167ea.slice/crio-2d42703db56bcb5a13461a8987f3726364ad2869ba528a5916c5c8da9130cf09 WatchSource:0}: Error finding container 2d42703db56bcb5a13461a8987f3726364ad2869ba528a5916c5c8da9130cf09: Status 404 returned error can't find the container with id 2d42703db56bcb5a13461a8987f3726364ad2869ba528a5916c5c8da9130cf09
Sep 10 15:22:09.214382 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:09.214345    2574 generic.go:356] "Generic (PLEG): container finished" podID="63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd" containerID="e51e4a5c8ff6af1dd1a44b8eeb681f3c06165924305b88a628f2b569958fcb21" exitCode=0
Sep 10 15:22:09.214804 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:09.214429    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc" event={"ID":"63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd","Type":"ContainerDied","Data":"e51e4a5c8ff6af1dd1a44b8eeb681f3c06165924305b88a628f2b569958fcb21"}
Sep 10 15:22:09.214804 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:09.214478    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc" event={"ID":"63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd","Type":"ContainerStarted","Data":"ddc7fe534b1c1ca6a660cab8a6f6cb98451dd4e5422d16f9f24d231d7f2f2bfd"}
Sep 10 15:22:09.216161 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:09.216139    2574 generic.go:356] "Generic (PLEG): container finished" podID="bec4378d-18cc-4cec-934d-976d0b8787ce" containerID="c6151553700b4b02b6c8b2b5e0708d28f20d5da6e3c5bdcb21fc31ee7ca9326c" exitCode=0
Sep 10 15:22:09.216258 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:09.216192    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw" event={"ID":"bec4378d-18cc-4cec-934d-976d0b8787ce","Type":"ContainerDied","Data":"c6151553700b4b02b6c8b2b5e0708d28f20d5da6e3c5bdcb21fc31ee7ca9326c"}
Sep 10 15:22:09.216258 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:09.216241    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw" event={"ID":"bec4378d-18cc-4cec-934d-976d0b8787ce","Type":"ContainerStarted","Data":"3bc4f8d99b30c45088b1b8b28ade731189bccdc54469f598f91b3399429a1aa0"}
Sep 10 15:22:09.217794 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:09.217775    2574 generic.go:356] "Generic (PLEG): container finished" podID="d018a782-f9e0-4da1-be09-dbc58d8167ea" containerID="b24f20ea2d4fbb9abbf4ce460532661bbdd63c87042d9d549450b832340cbaba" exitCode=0
Sep 10 15:22:09.217890 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:09.217859    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq" event={"ID":"d018a782-f9e0-4da1-be09-dbc58d8167ea","Type":"ContainerDied","Data":"b24f20ea2d4fbb9abbf4ce460532661bbdd63c87042d9d549450b832340cbaba"}
Sep 10 15:22:09.217974 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:09.217901    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq" event={"ID":"d018a782-f9e0-4da1-be09-dbc58d8167ea","Type":"ContainerStarted","Data":"2d42703db56bcb5a13461a8987f3726364ad2869ba528a5916c5c8da9130cf09"}
Sep 10 15:22:09.219583 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:09.219560    2574 generic.go:356] "Generic (PLEG): container finished" podID="f943eafd-d9de-4baa-b9d7-dbe0eb05e294" containerID="5e931d5d578bb821aa93964fca5c5c8cf9edb969a51094c2fe66e839120f5b46" exitCode=0
Sep 10 15:22:09.219669 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:09.219638    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8" event={"ID":"f943eafd-d9de-4baa-b9d7-dbe0eb05e294","Type":"ContainerDied","Data":"5e931d5d578bb821aa93964fca5c5c8cf9edb969a51094c2fe66e839120f5b46"}
Sep 10 15:22:09.219745 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:09.219675    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8" event={"ID":"f943eafd-d9de-4baa-b9d7-dbe0eb05e294","Type":"ContainerStarted","Data":"bd62485286dd6343fe41063d9c5c3ddd0ce66dc49b874101bba65d60e46d47f1"}
Sep 10 15:22:10.228719 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:10.228676    2574 generic.go:356] "Generic (PLEG): container finished" podID="f943eafd-d9de-4baa-b9d7-dbe0eb05e294" containerID="bd16a247bc827b3eb91db452219e4f9dc82addbf793cccf8ec69f61c1a1eb07a" exitCode=0
Sep 10 15:22:10.229114 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:10.228761    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8" event={"ID":"f943eafd-d9de-4baa-b9d7-dbe0eb05e294","Type":"ContainerDied","Data":"bd16a247bc827b3eb91db452219e4f9dc82addbf793cccf8ec69f61c1a1eb07a"}
Sep 10 15:22:11.235619 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:11.235580    2574 generic.go:356] "Generic (PLEG): container finished" podID="d018a782-f9e0-4da1-be09-dbc58d8167ea" containerID="0f77827ee4c332b4baa1ed9e1d4732dc31b49c2f4d0ebad0af49e77ad2506491" exitCode=0
Sep 10 15:22:11.235619 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:11.235613    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq" event={"ID":"d018a782-f9e0-4da1-be09-dbc58d8167ea","Type":"ContainerDied","Data":"0f77827ee4c332b4baa1ed9e1d4732dc31b49c2f4d0ebad0af49e77ad2506491"}
Sep 10 15:22:11.237997 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:11.237975    2574 generic.go:356] "Generic (PLEG): container finished" podID="f943eafd-d9de-4baa-b9d7-dbe0eb05e294" containerID="9829cc8a6a016949e6a86cb1602083944b47ce03cfc88c52f16178a105443970" exitCode=0
Sep 10 15:22:11.238091 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:11.238062    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8" event={"ID":"f943eafd-d9de-4baa-b9d7-dbe0eb05e294","Type":"ContainerDied","Data":"9829cc8a6a016949e6a86cb1602083944b47ce03cfc88c52f16178a105443970"}
Sep 10 15:22:11.240105 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:11.239998    2574 generic.go:356] "Generic (PLEG): container finished" podID="63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd" containerID="b18636996869e413b74ddd54f244912af2a538547a6bae29ecadacff82d6aed2" exitCode=0
Sep 10 15:22:11.240105 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:11.240077    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc" event={"ID":"63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd","Type":"ContainerDied","Data":"b18636996869e413b74ddd54f244912af2a538547a6bae29ecadacff82d6aed2"}
Sep 10 15:22:11.242079 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:11.242060    2574 generic.go:356] "Generic (PLEG): container finished" podID="bec4378d-18cc-4cec-934d-976d0b8787ce" containerID="32ace695d0ca43ff41b33779054ec421125933cd74b8d6e8e4c231342d0503fb" exitCode=0
Sep 10 15:22:11.242162 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:11.242111    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw" event={"ID":"bec4378d-18cc-4cec-934d-976d0b8787ce","Type":"ContainerDied","Data":"32ace695d0ca43ff41b33779054ec421125933cd74b8d6e8e4c231342d0503fb"}
Sep 10 15:22:12.249742 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:12.249697    2574 generic.go:356] "Generic (PLEG): container finished" podID="63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd" containerID="41d4fe1f1bed3ad4d400ae4c4a914d63e153b34b8b297458d51eead81ffc2f83" exitCode=0
Sep 10 15:22:12.250177 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:12.249770    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc" event={"ID":"63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd","Type":"ContainerDied","Data":"41d4fe1f1bed3ad4d400ae4c4a914d63e153b34b8b297458d51eead81ffc2f83"}
Sep 10 15:22:12.251982 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:12.251959    2574 generic.go:356] "Generic (PLEG): container finished" podID="bec4378d-18cc-4cec-934d-976d0b8787ce" containerID="76f99773882828ba96aee366d8e53bbd52b2db9320f7416e8435cb7e37f97301" exitCode=0
Sep 10 15:22:12.252085 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:12.252042    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw" event={"ID":"bec4378d-18cc-4cec-934d-976d0b8787ce","Type":"ContainerDied","Data":"76f99773882828ba96aee366d8e53bbd52b2db9320f7416e8435cb7e37f97301"}
Sep 10 15:22:12.254029 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:12.254009    2574 generic.go:356] "Generic (PLEG): container finished" podID="d018a782-f9e0-4da1-be09-dbc58d8167ea" containerID="7f4cc66bd15c540721eb281b0d2f03844e59fae5e9257eea2d4e61b33350db86" exitCode=0
Sep 10 15:22:12.254117 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:12.254072    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq" event={"ID":"d018a782-f9e0-4da1-be09-dbc58d8167ea","Type":"ContainerDied","Data":"7f4cc66bd15c540721eb281b0d2f03844e59fae5e9257eea2d4e61b33350db86"}
Sep 10 15:22:12.384875 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:12.384849    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8"
Sep 10 15:22:12.502771 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:12.502735    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxk88\" (UniqueName: \"kubernetes.io/projected/f943eafd-d9de-4baa-b9d7-dbe0eb05e294-kube-api-access-dxk88\") pod \"f943eafd-d9de-4baa-b9d7-dbe0eb05e294\" (UID: \"f943eafd-d9de-4baa-b9d7-dbe0eb05e294\") "
Sep 10 15:22:12.502969 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:12.502827    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f943eafd-d9de-4baa-b9d7-dbe0eb05e294-util\") pod \"f943eafd-d9de-4baa-b9d7-dbe0eb05e294\" (UID: \"f943eafd-d9de-4baa-b9d7-dbe0eb05e294\") "
Sep 10 15:22:12.502969 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:12.502858    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f943eafd-d9de-4baa-b9d7-dbe0eb05e294-bundle\") pod \"f943eafd-d9de-4baa-b9d7-dbe0eb05e294\" (UID: \"f943eafd-d9de-4baa-b9d7-dbe0eb05e294\") "
Sep 10 15:22:12.503411 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:12.503377    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f943eafd-d9de-4baa-b9d7-dbe0eb05e294-bundle" (OuterVolumeSpecName: "bundle") pod "f943eafd-d9de-4baa-b9d7-dbe0eb05e294" (UID: "f943eafd-d9de-4baa-b9d7-dbe0eb05e294"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:22:12.504858 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:12.504834    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f943eafd-d9de-4baa-b9d7-dbe0eb05e294-kube-api-access-dxk88" (OuterVolumeSpecName: "kube-api-access-dxk88") pod "f943eafd-d9de-4baa-b9d7-dbe0eb05e294" (UID: "f943eafd-d9de-4baa-b9d7-dbe0eb05e294"). InnerVolumeSpecName "kube-api-access-dxk88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:22:12.508019 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:12.507999    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f943eafd-d9de-4baa-b9d7-dbe0eb05e294-util" (OuterVolumeSpecName: "util") pod "f943eafd-d9de-4baa-b9d7-dbe0eb05e294" (UID: "f943eafd-d9de-4baa-b9d7-dbe0eb05e294"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:22:12.604585 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:12.604549    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f943eafd-d9de-4baa-b9d7-dbe0eb05e294-util\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:22:12.604585 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:12.604577    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f943eafd-d9de-4baa-b9d7-dbe0eb05e294-bundle\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:22:12.604585 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:12.604586    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxk88\" (UniqueName: \"kubernetes.io/projected/f943eafd-d9de-4baa-b9d7-dbe0eb05e294-kube-api-access-dxk88\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:22:13.261161 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.261133    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8"
Sep 10 15:22:13.261694 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.261184    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpvfg8" event={"ID":"f943eafd-d9de-4baa-b9d7-dbe0eb05e294","Type":"ContainerDied","Data":"bd62485286dd6343fe41063d9c5c3ddd0ce66dc49b874101bba65d60e46d47f1"}
Sep 10 15:22:13.261694 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.261251    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd62485286dd6343fe41063d9c5c3ddd0ce66dc49b874101bba65d60e46d47f1"
Sep 10 15:22:13.401833 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.401804    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq"
Sep 10 15:22:13.448611 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.448581    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc"
Sep 10 15:22:13.451686 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.451666    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw"
Sep 10 15:22:13.510768 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.510734    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d018a782-f9e0-4da1-be09-dbc58d8167ea-bundle\") pod \"d018a782-f9e0-4da1-be09-dbc58d8167ea\" (UID: \"d018a782-f9e0-4da1-be09-dbc58d8167ea\") "
Sep 10 15:22:13.510975 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.510785    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sp6cc\" (UniqueName: \"kubernetes.io/projected/d018a782-f9e0-4da1-be09-dbc58d8167ea-kube-api-access-sp6cc\") pod \"d018a782-f9e0-4da1-be09-dbc58d8167ea\" (UID: \"d018a782-f9e0-4da1-be09-dbc58d8167ea\") "
Sep 10 15:22:13.510975 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.510852    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d018a782-f9e0-4da1-be09-dbc58d8167ea-util\") pod \"d018a782-f9e0-4da1-be09-dbc58d8167ea\" (UID: \"d018a782-f9e0-4da1-be09-dbc58d8167ea\") "
Sep 10 15:22:13.511319 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.511248    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d018a782-f9e0-4da1-be09-dbc58d8167ea-bundle" (OuterVolumeSpecName: "bundle") pod "d018a782-f9e0-4da1-be09-dbc58d8167ea" (UID: "d018a782-f9e0-4da1-be09-dbc58d8167ea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:22:13.512892 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.512870    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d018a782-f9e0-4da1-be09-dbc58d8167ea-kube-api-access-sp6cc" (OuterVolumeSpecName: "kube-api-access-sp6cc") pod "d018a782-f9e0-4da1-be09-dbc58d8167ea" (UID: "d018a782-f9e0-4da1-be09-dbc58d8167ea"). InnerVolumeSpecName "kube-api-access-sp6cc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:22:13.516113 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.516094    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d018a782-f9e0-4da1-be09-dbc58d8167ea-util" (OuterVolumeSpecName: "util") pod "d018a782-f9e0-4da1-be09-dbc58d8167ea" (UID: "d018a782-f9e0-4da1-be09-dbc58d8167ea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:22:13.611815 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.611772    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrk8g\" (UniqueName: \"kubernetes.io/projected/bec4378d-18cc-4cec-934d-976d0b8787ce-kube-api-access-nrk8g\") pod \"bec4378d-18cc-4cec-934d-976d0b8787ce\" (UID: \"bec4378d-18cc-4cec-934d-976d0b8787ce\") "
Sep 10 15:22:13.612011 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.611868    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g9vk\" (UniqueName: \"kubernetes.io/projected/63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd-kube-api-access-4g9vk\") pod \"63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd\" (UID: \"63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd\") "
Sep 10 15:22:13.612011 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.611907    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd-util\") pod \"63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd\" (UID: \"63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd\") "
Sep 10 15:22:13.612011 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.611974    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd-bundle\") pod \"63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd\" (UID: \"63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd\") "
Sep 10 15:22:13.612011 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.611995    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bec4378d-18cc-4cec-934d-976d0b8787ce-util\") pod \"bec4378d-18cc-4cec-934d-976d0b8787ce\" (UID: \"bec4378d-18cc-4cec-934d-976d0b8787ce\") "
Sep 10 15:22:13.612200 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.612017    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bec4378d-18cc-4cec-934d-976d0b8787ce-bundle\") pod \"bec4378d-18cc-4cec-934d-976d0b8787ce\" (UID: \"bec4378d-18cc-4cec-934d-976d0b8787ce\") "
Sep 10 15:22:13.612285 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.612261    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d018a782-f9e0-4da1-be09-dbc58d8167ea-bundle\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:22:13.612358 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.612287    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sp6cc\" (UniqueName: \"kubernetes.io/projected/d018a782-f9e0-4da1-be09-dbc58d8167ea-kube-api-access-sp6cc\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:22:13.612358 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.612302    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d018a782-f9e0-4da1-be09-dbc58d8167ea-util\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:22:13.612601 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.612572    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd-bundle" (OuterVolumeSpecName: "bundle") pod "63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd" (UID: "63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:22:13.612870 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.612833    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bec4378d-18cc-4cec-934d-976d0b8787ce-bundle" (OuterVolumeSpecName: "bundle") pod "bec4378d-18cc-4cec-934d-976d0b8787ce" (UID: "bec4378d-18cc-4cec-934d-976d0b8787ce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:22:13.614014 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.613994    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd-kube-api-access-4g9vk" (OuterVolumeSpecName: "kube-api-access-4g9vk") pod "63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd" (UID: "63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd"). InnerVolumeSpecName "kube-api-access-4g9vk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:22:13.614287 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.614254    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bec4378d-18cc-4cec-934d-976d0b8787ce-kube-api-access-nrk8g" (OuterVolumeSpecName: "kube-api-access-nrk8g") pod "bec4378d-18cc-4cec-934d-976d0b8787ce" (UID: "bec4378d-18cc-4cec-934d-976d0b8787ce"). InnerVolumeSpecName "kube-api-access-nrk8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:22:13.617997 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.617974    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bec4378d-18cc-4cec-934d-976d0b8787ce-util" (OuterVolumeSpecName: "util") pod "bec4378d-18cc-4cec-934d-976d0b8787ce" (UID: "bec4378d-18cc-4cec-934d-976d0b8787ce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:22:13.618737 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.618712    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd-util" (OuterVolumeSpecName: "util") pod "63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd" (UID: "63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:22:13.712838 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.712805    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g9vk\" (UniqueName: \"kubernetes.io/projected/63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd-kube-api-access-4g9vk\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:22:13.712838 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.712833    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd-util\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:22:13.712838 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.712843    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd-bundle\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:22:13.713084 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.712850    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bec4378d-18cc-4cec-934d-976d0b8787ce-util\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:22:13.713084 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.712858    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bec4378d-18cc-4cec-934d-976d0b8787ce-bundle\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:22:13.713084 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:13.712866    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrk8g\" (UniqueName: \"kubernetes.io/projected/bec4378d-18cc-4cec-934d-976d0b8787ce-kube-api-access-nrk8g\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:22:14.268834 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:14.268803    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc"
Sep 10 15:22:14.269303 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:14.268802    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76jtjc" event={"ID":"63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd","Type":"ContainerDied","Data":"ddc7fe534b1c1ca6a660cab8a6f6cb98451dd4e5422d16f9f24d231d7f2f2bfd"}
Sep 10 15:22:14.269303 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:14.268948    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ddc7fe534b1c1ca6a660cab8a6f6cb98451dd4e5422d16f9f24d231d7f2f2bfd"
Sep 10 15:22:14.270758 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:14.270736    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw"
Sep 10 15:22:14.270891 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:14.270734    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alchmw" event={"ID":"bec4378d-18cc-4cec-934d-976d0b8787ce","Type":"ContainerDied","Data":"3bc4f8d99b30c45088b1b8b28ade731189bccdc54469f598f91b3399429a1aa0"}
Sep 10 15:22:14.270891 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:14.270846    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3bc4f8d99b30c45088b1b8b28ade731189bccdc54469f598f91b3399429a1aa0"
Sep 10 15:22:14.272696 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:14.272677    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq"
Sep 10 15:22:14.272809 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:14.272694    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f9lqq" event={"ID":"d018a782-f9e0-4da1-be09-dbc58d8167ea","Type":"ContainerDied","Data":"2d42703db56bcb5a13461a8987f3726364ad2869ba528a5916c5c8da9130cf09"}
Sep 10 15:22:14.272809 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:14.272725    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d42703db56bcb5a13461a8987f3726364ad2869ba528a5916c5c8da9130cf09"
Sep 10 15:22:34.078220 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078155    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fd56c4b48-tw2fg"]
Sep 10 15:22:34.078881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078663    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f943eafd-d9de-4baa-b9d7-dbe0eb05e294" containerName="util"
Sep 10 15:22:34.078881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078686    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f943eafd-d9de-4baa-b9d7-dbe0eb05e294" containerName="util"
Sep 10 15:22:34.078881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078699    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd" containerName="pull"
Sep 10 15:22:34.078881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078709    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd" containerName="pull"
Sep 10 15:22:34.078881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078726    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f943eafd-d9de-4baa-b9d7-dbe0eb05e294" containerName="pull"
Sep 10 15:22:34.078881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078734    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f943eafd-d9de-4baa-b9d7-dbe0eb05e294" containerName="pull"
Sep 10 15:22:34.078881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078744    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bec4378d-18cc-4cec-934d-976d0b8787ce" containerName="extract"
Sep 10 15:22:34.078881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078752    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bec4378d-18cc-4cec-934d-976d0b8787ce" containerName="extract"
Sep 10 15:22:34.078881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078766    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd" containerName="extract"
Sep 10 15:22:34.078881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078775    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd" containerName="extract"
Sep 10 15:22:34.078881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078788    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d018a782-f9e0-4da1-be09-dbc58d8167ea" containerName="util"
Sep 10 15:22:34.078881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078797    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d018a782-f9e0-4da1-be09-dbc58d8167ea" containerName="util"
Sep 10 15:22:34.078881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078805    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d018a782-f9e0-4da1-be09-dbc58d8167ea" containerName="extract"
Sep 10 15:22:34.078881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078813    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d018a782-f9e0-4da1-be09-dbc58d8167ea" containerName="extract"
Sep 10 15:22:34.078881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078827    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f943eafd-d9de-4baa-b9d7-dbe0eb05e294" containerName="extract"
Sep 10 15:22:34.078881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078835    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f943eafd-d9de-4baa-b9d7-dbe0eb05e294" containerName="extract"
Sep 10 15:22:34.078881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078852    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bec4378d-18cc-4cec-934d-976d0b8787ce" containerName="util"
Sep 10 15:22:34.078881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078871    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bec4378d-18cc-4cec-934d-976d0b8787ce" containerName="util"
Sep 10 15:22:34.078881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078883    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd" containerName="util"
Sep 10 15:22:34.078881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078892    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd" containerName="util"
Sep 10 15:22:34.079894 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078904    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d018a782-f9e0-4da1-be09-dbc58d8167ea" containerName="pull"
Sep 10 15:22:34.079894 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078912    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d018a782-f9e0-4da1-be09-dbc58d8167ea" containerName="pull"
Sep 10 15:22:34.079894 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078924    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bec4378d-18cc-4cec-934d-976d0b8787ce" containerName="pull"
Sep 10 15:22:34.079894 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.078947    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bec4378d-18cc-4cec-934d-976d0b8787ce" containerName="pull"
Sep 10 15:22:34.079894 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.079059    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f943eafd-d9de-4baa-b9d7-dbe0eb05e294" containerName="extract"
Sep 10 15:22:34.079894 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.079070    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bec4378d-18cc-4cec-934d-976d0b8787ce" containerName="extract"
Sep 10 15:22:34.079894 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.079078    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d018a782-f9e0-4da1-be09-dbc58d8167ea" containerName="extract"
Sep 10 15:22:34.079894 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.079087    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="63c65bb6-971c-4f1f-bbf2-ba48ba4dfcdd" containerName="extract"
Sep 10 15:22:34.082670 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.082647    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.096859 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.096834    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fd56c4b48-tw2fg"]
Sep 10 15:22:34.182810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.182774    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b54966a-e32a-4d80-878e-9b0bdd403256-console-config\") pod \"console-6fd56c4b48-tw2fg\" (UID: \"2b54966a-e32a-4d80-878e-9b0bdd403256\") " pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.183011 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.182818    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b54966a-e32a-4d80-878e-9b0bdd403256-service-ca\") pod \"console-6fd56c4b48-tw2fg\" (UID: \"2b54966a-e32a-4d80-878e-9b0bdd403256\") " pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.183011 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.182844    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b54966a-e32a-4d80-878e-9b0bdd403256-oauth-serving-cert\") pod \"console-6fd56c4b48-tw2fg\" (UID: \"2b54966a-e32a-4d80-878e-9b0bdd403256\") " pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.183011 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.182870    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b54966a-e32a-4d80-878e-9b0bdd403256-console-serving-cert\") pod \"console-6fd56c4b48-tw2fg\" (UID: \"2b54966a-e32a-4d80-878e-9b0bdd403256\") " pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.183011 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.182901    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b54966a-e32a-4d80-878e-9b0bdd403256-console-oauth-config\") pod \"console-6fd56c4b48-tw2fg\" (UID: \"2b54966a-e32a-4d80-878e-9b0bdd403256\") " pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.183011 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.182924    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mskdq\" (UniqueName: \"kubernetes.io/projected/2b54966a-e32a-4d80-878e-9b0bdd403256-kube-api-access-mskdq\") pod \"console-6fd56c4b48-tw2fg\" (UID: \"2b54966a-e32a-4d80-878e-9b0bdd403256\") " pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.183183 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.183035    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b54966a-e32a-4d80-878e-9b0bdd403256-trusted-ca-bundle\") pod \"console-6fd56c4b48-tw2fg\" (UID: \"2b54966a-e32a-4d80-878e-9b0bdd403256\") " pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.283917 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.283867    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b54966a-e32a-4d80-878e-9b0bdd403256-console-config\") pod \"console-6fd56c4b48-tw2fg\" (UID: \"2b54966a-e32a-4d80-878e-9b0bdd403256\") " pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.284109 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.283955    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b54966a-e32a-4d80-878e-9b0bdd403256-service-ca\") pod \"console-6fd56c4b48-tw2fg\" (UID: \"2b54966a-e32a-4d80-878e-9b0bdd403256\") " pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.284109 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.283981    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b54966a-e32a-4d80-878e-9b0bdd403256-oauth-serving-cert\") pod \"console-6fd56c4b48-tw2fg\" (UID: \"2b54966a-e32a-4d80-878e-9b0bdd403256\") " pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.284109 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.284011    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b54966a-e32a-4d80-878e-9b0bdd403256-console-serving-cert\") pod \"console-6fd56c4b48-tw2fg\" (UID: \"2b54966a-e32a-4d80-878e-9b0bdd403256\") " pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.284210 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.284145    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b54966a-e32a-4d80-878e-9b0bdd403256-console-oauth-config\") pod \"console-6fd56c4b48-tw2fg\" (UID: \"2b54966a-e32a-4d80-878e-9b0bdd403256\") " pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.284210 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.284200    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mskdq\" (UniqueName: \"kubernetes.io/projected/2b54966a-e32a-4d80-878e-9b0bdd403256-kube-api-access-mskdq\") pod \"console-6fd56c4b48-tw2fg\" (UID: \"2b54966a-e32a-4d80-878e-9b0bdd403256\") " pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.284312 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.284271    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b54966a-e32a-4d80-878e-9b0bdd403256-trusted-ca-bundle\") pod \"console-6fd56c4b48-tw2fg\" (UID: \"2b54966a-e32a-4d80-878e-9b0bdd403256\") " pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.284776 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.284748    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b54966a-e32a-4d80-878e-9b0bdd403256-console-config\") pod \"console-6fd56c4b48-tw2fg\" (UID: \"2b54966a-e32a-4d80-878e-9b0bdd403256\") " pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.284776 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.284760    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b54966a-e32a-4d80-878e-9b0bdd403256-service-ca\") pod \"console-6fd56c4b48-tw2fg\" (UID: \"2b54966a-e32a-4d80-878e-9b0bdd403256\") " pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.284957 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.284768    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b54966a-e32a-4d80-878e-9b0bdd403256-oauth-serving-cert\") pod \"console-6fd56c4b48-tw2fg\" (UID: \"2b54966a-e32a-4d80-878e-9b0bdd403256\") " pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.285146 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.285126    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b54966a-e32a-4d80-878e-9b0bdd403256-trusted-ca-bundle\") pod \"console-6fd56c4b48-tw2fg\" (UID: \"2b54966a-e32a-4d80-878e-9b0bdd403256\") " pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.286694 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.286669    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b54966a-e32a-4d80-878e-9b0bdd403256-console-oauth-config\") pod \"console-6fd56c4b48-tw2fg\" (UID: \"2b54966a-e32a-4d80-878e-9b0bdd403256\") " pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.286694 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.286687    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b54966a-e32a-4d80-878e-9b0bdd403256-console-serving-cert\") pod \"console-6fd56c4b48-tw2fg\" (UID: \"2b54966a-e32a-4d80-878e-9b0bdd403256\") " pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.293251 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.293231    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mskdq\" (UniqueName: \"kubernetes.io/projected/2b54966a-e32a-4d80-878e-9b0bdd403256-kube-api-access-mskdq\") pod \"console-6fd56c4b48-tw2fg\" (UID: \"2b54966a-e32a-4d80-878e-9b0bdd403256\") " pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.393052 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.392958    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:34.670458 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:34.670424    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fd56c4b48-tw2fg"]
Sep 10 15:22:34.671983 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:22:34.671952    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b54966a_e32a_4d80_878e_9b0bdd403256.slice/crio-cfffacd2e6e2d24dbe12710de7a6eb3a30ee90bdf61cdfb30a9a684675fa03e2 WatchSource:0}: Error finding container cfffacd2e6e2d24dbe12710de7a6eb3a30ee90bdf61cdfb30a9a684675fa03e2: Status 404 returned error can't find the container with id cfffacd2e6e2d24dbe12710de7a6eb3a30ee90bdf61cdfb30a9a684675fa03e2
Sep 10 15:22:35.386175 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:35.386133    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd56c4b48-tw2fg" event={"ID":"2b54966a-e32a-4d80-878e-9b0bdd403256","Type":"ContainerStarted","Data":"621798479e1c84882e0971d5c0af2cc88bd96385cd747c6b037ac68798ac6223"}
Sep 10 15:22:35.386545 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:35.386194    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd56c4b48-tw2fg" event={"ID":"2b54966a-e32a-4d80-878e-9b0bdd403256","Type":"ContainerStarted","Data":"cfffacd2e6e2d24dbe12710de7a6eb3a30ee90bdf61cdfb30a9a684675fa03e2"}
Sep 10 15:22:35.407764 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:35.407600    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fd56c4b48-tw2fg" podStartSLOduration=1.407581121 podStartE2EDuration="1.407581121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:22:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:22:35.40715289 +0000 UTC m=+408.456951422" watchObservedRunningTime="2026-09-10 15:22:35.407581121 +0000 UTC m=+408.457379633"
Sep 10 15:22:44.393233 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:44.393188    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:44.393734 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:44.393258    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:44.398082 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:44.398058    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:44.436182 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:44.436153    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fd56c4b48-tw2fg"
Sep 10 15:22:44.497680 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:22:44.497636    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7599c7c697-thx7t"]
Sep 10 15:23:09.519112 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:09.519045    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7599c7c697-thx7t" podUID="a1ca85fe-ba35-4e18-8669-0d23e2c3718a" containerName="console" containerID="cri-o://f449aee17217851bef0b712267a3e4bf6d41a47ca8cf5298ee02484171179857" gracePeriod=15
Sep 10 15:23:09.773303 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:09.773244    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:23:09.901545 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:09.901512    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-trusted-ca-bundle\") pod \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") "
Sep 10 15:23:09.901719 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:09.901552    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-console-serving-cert\") pod \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") "
Sep 10 15:23:09.901719 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:09.901592    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-console-config\") pod \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") "
Sep 10 15:23:09.901719 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:09.901635    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-oauth-serving-cert\") pod \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") "
Sep 10 15:23:09.901719 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:09.901665    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-console-oauth-config\") pod \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") "
Sep 10 15:23:09.901719 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:09.901693    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpl78\" (UniqueName: \"kubernetes.io/projected/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-kube-api-access-tpl78\") pod \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") "
Sep 10 15:23:09.901996 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:09.901725    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-service-ca\") pod \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\" (UID: \"a1ca85fe-ba35-4e18-8669-0d23e2c3718a\") "
Sep 10 15:23:09.902061 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:09.901996    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a1ca85fe-ba35-4e18-8669-0d23e2c3718a" (UID: "a1ca85fe-ba35-4e18-8669-0d23e2c3718a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:23:09.902061 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:09.902031    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-console-config" (OuterVolumeSpecName: "console-config") pod "a1ca85fe-ba35-4e18-8669-0d23e2c3718a" (UID: "a1ca85fe-ba35-4e18-8669-0d23e2c3718a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:23:09.902197 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:09.902161    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a1ca85fe-ba35-4e18-8669-0d23e2c3718a" (UID: "a1ca85fe-ba35-4e18-8669-0d23e2c3718a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:23:09.902342 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:09.902245    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-service-ca" (OuterVolumeSpecName: "service-ca") pod "a1ca85fe-ba35-4e18-8669-0d23e2c3718a" (UID: "a1ca85fe-ba35-4e18-8669-0d23e2c3718a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:23:09.903857 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:09.903834    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a1ca85fe-ba35-4e18-8669-0d23e2c3718a" (UID: "a1ca85fe-ba35-4e18-8669-0d23e2c3718a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:23:09.903981 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:09.903856    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a1ca85fe-ba35-4e18-8669-0d23e2c3718a" (UID: "a1ca85fe-ba35-4e18-8669-0d23e2c3718a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:23:09.903981 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:09.903891    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-kube-api-access-tpl78" (OuterVolumeSpecName: "kube-api-access-tpl78") pod "a1ca85fe-ba35-4e18-8669-0d23e2c3718a" (UID: "a1ca85fe-ba35-4e18-8669-0d23e2c3718a"). InnerVolumeSpecName "kube-api-access-tpl78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:23:10.002829 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:10.002790    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-oauth-serving-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:23:10.002829 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:10.002821    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-console-oauth-config\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:23:10.002829 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:10.002832    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpl78\" (UniqueName: \"kubernetes.io/projected/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-kube-api-access-tpl78\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:23:10.002829 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:10.002841    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-service-ca\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:23:10.003135 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:10.002850    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-trusted-ca-bundle\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:23:10.003135 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:10.002858    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-console-serving-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:23:10.003135 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:10.002867    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1ca85fe-ba35-4e18-8669-0d23e2c3718a-console-config\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:23:10.564660 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:10.564620    2574 generic.go:356] "Generic (PLEG): container finished" podID="a1ca85fe-ba35-4e18-8669-0d23e2c3718a" containerID="f449aee17217851bef0b712267a3e4bf6d41a47ca8cf5298ee02484171179857" exitCode=0
Sep 10 15:23:10.564660 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:10.564666    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7599c7c697-thx7t"
Sep 10 15:23:10.565218 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:10.564679    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7599c7c697-thx7t" event={"ID":"a1ca85fe-ba35-4e18-8669-0d23e2c3718a","Type":"ContainerDied","Data":"f449aee17217851bef0b712267a3e4bf6d41a47ca8cf5298ee02484171179857"}
Sep 10 15:23:10.565218 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:10.564723    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7599c7c697-thx7t" event={"ID":"a1ca85fe-ba35-4e18-8669-0d23e2c3718a","Type":"ContainerDied","Data":"1944a7bd06fb535811a0718fed061b1254950f3bb2f80edfa4d49fc49732d883"}
Sep 10 15:23:10.565218 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:10.564746    2574 scope.go:117] "RemoveContainer" containerID="f449aee17217851bef0b712267a3e4bf6d41a47ca8cf5298ee02484171179857"
Sep 10 15:23:10.574733 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:10.574714    2574 scope.go:117] "RemoveContainer" containerID="f449aee17217851bef0b712267a3e4bf6d41a47ca8cf5298ee02484171179857"
Sep 10 15:23:10.574998 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:23:10.574980    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f449aee17217851bef0b712267a3e4bf6d41a47ca8cf5298ee02484171179857\": container with ID starting with f449aee17217851bef0b712267a3e4bf6d41a47ca8cf5298ee02484171179857 not found: ID does not exist" containerID="f449aee17217851bef0b712267a3e4bf6d41a47ca8cf5298ee02484171179857"
Sep 10 15:23:10.575053 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:10.575006    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f449aee17217851bef0b712267a3e4bf6d41a47ca8cf5298ee02484171179857"} err="failed to get container status \"f449aee17217851bef0b712267a3e4bf6d41a47ca8cf5298ee02484171179857\": rpc error: code = NotFound desc = could not find container \"f449aee17217851bef0b712267a3e4bf6d41a47ca8cf5298ee02484171179857\": container with ID starting with f449aee17217851bef0b712267a3e4bf6d41a47ca8cf5298ee02484171179857 not found: ID does not exist"
Sep 10 15:23:10.590542 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:10.590518    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7599c7c697-thx7t"]
Sep 10 15:23:10.593878 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:10.593859    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7599c7c697-thx7t"]
Sep 10 15:23:11.409480 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:11.409445    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1ca85fe-ba35-4e18-8669-0d23e2c3718a" path="/var/lib/kubelet/pods/a1ca85fe-ba35-4e18-8669-0d23e2c3718a/volumes"
Sep 10 15:23:14.210230 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.210194    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"]
Sep 10 15:23:14.210597 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.210565    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1ca85fe-ba35-4e18-8669-0d23e2c3718a" containerName="console"
Sep 10 15:23:14.210597 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.210576    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1ca85fe-ba35-4e18-8669-0d23e2c3718a" containerName="console"
Sep 10 15:23:14.210666 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.210641    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1ca85fe-ba35-4e18-8669-0d23e2c3718a" containerName="console"
Sep 10 15:23:14.212582 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.212565    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.215528 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.215506    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fmsrj\""
Sep 10 15:23:14.225567 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.225546    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"]
Sep 10 15:23:14.341145 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.341105    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.341145 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.341149    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.341419 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.341170    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.341419 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.341278    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.341419 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.341318    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.341419 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.341352    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.341419 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.341385    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.341626 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.341457    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdnkw\" (UniqueName: \"kubernetes.io/projected/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-kube-api-access-tdnkw\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.341626 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.341516    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.442711 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.442677    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.442904 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.442726    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdnkw\" (UniqueName: \"kubernetes.io/projected/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-kube-api-access-tdnkw\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.442904 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.442750    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.442904 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.442782    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.442904 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.442802    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.442904 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.442827    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.442904 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.442882    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.443195 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.442912    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.443195 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.442959    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.443313 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.443284    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.443488 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.443441    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.443681 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.443658    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.443771 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.443737    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.443771 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.443757    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.445111 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.445089    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.445507 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.445491    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.451634 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.451610    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.451763 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.451743    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdnkw\" (UniqueName: \"kubernetes.io/projected/2df55bcd-b9f3-4d4e-8ea6-e3521fc06634-kube-api-access-tdnkw\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4grxn\" (UID: \"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.523063 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.522977    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:14.802749 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.802724    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"]
Sep 10 15:23:14.805225 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:23:14.805199    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df55bcd_b9f3_4d4e_8ea6_e3521fc06634.slice/crio-611f57d7f8bce8ac3a4e0b71b05f232387b0e645ac13d3b01f1060471b284665 WatchSource:0}: Error finding container 611f57d7f8bce8ac3a4e0b71b05f232387b0e645ac13d3b01f1060471b284665: Status 404 returned error can't find the container with id 611f57d7f8bce8ac3a4e0b71b05f232387b0e645ac13d3b01f1060471b284665
Sep 10 15:23:14.807319 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.807289    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:23:14.807381 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.807353    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:23:14.807417 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:14.807400    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:23:15.597223 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:15.597189    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn" event={"ID":"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634","Type":"ContainerStarted","Data":"38fc074d380327cd3fe6ab8573a36bf9d224871fc1647c1bf5cd1699555d4ba2"}
Sep 10 15:23:15.597685 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:15.597245    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn" event={"ID":"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634","Type":"ContainerStarted","Data":"611f57d7f8bce8ac3a4e0b71b05f232387b0e645ac13d3b01f1060471b284665"}
Sep 10 15:23:15.622127 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:15.622069    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn" podStartSLOduration=1.622054099 podStartE2EDuration="1.622054099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:23:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:23:15.619829144 +0000 UTC m=+448.669627653" watchObservedRunningTime="2026-09-10 15:23:15.622054099 +0000 UTC m=+448.671852606"
Sep 10 15:23:16.524133 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:16.524096    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:16.528831 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:16.528805    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:16.602000 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:16.601960    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:23:16.602966 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:23:16.602920    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:25:01.146107 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:01.146071    2574 generic.go:356] "Generic (PLEG): container finished" podID="2df55bcd-b9f3-4d4e-8ea6-e3521fc06634" containerID="38fc074d380327cd3fe6ab8573a36bf9d224871fc1647c1bf5cd1699555d4ba2" exitCode=0
Sep 10 15:25:01.146630 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:01.146151    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn" event={"ID":"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634","Type":"ContainerDied","Data":"38fc074d380327cd3fe6ab8573a36bf9d224871fc1647c1bf5cd1699555d4ba2"}
Sep 10 15:25:01.146704 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:01.146640    2574 scope.go:117] "RemoveContainer" containerID="38fc074d380327cd3fe6ab8573a36bf9d224871fc1647c1bf5cd1699555d4ba2"
Sep 10 15:25:01.147662 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:01.147635    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:25:01.147738 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:01.147719    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:25:01.147789 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:01.147773    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:25:01.602514 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:01.602475    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:25:02.156826 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:02.156793    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn" event={"ID":"2df55bcd-b9f3-4d4e-8ea6-e3521fc06634","Type":"ContainerStarted","Data":"9e7115af415753f15da9f395d55c39431c56243ba261b4b3fa77044a196de37a"}
Sep 10 15:25:02.524186 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:02.524109    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:25:02.525267 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:02.525242    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-4grxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 10 15:25:02.525394 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:02.525302    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn" podUID="2df55bcd-b9f3-4d4e-8ea6-e3521fc06634" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 10 15:25:03.524318 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:03.524286    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-4grxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 10 15:25:03.524680 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:03.524339    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn" podUID="2df55bcd-b9f3-4d4e-8ea6-e3521fc06634" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 10 15:25:04.523764 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:04.523729    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-4grxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 10 15:25:04.523956 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:04.523782    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn" podUID="2df55bcd-b9f3-4d4e-8ea6-e3521fc06634" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 10 15:25:05.524036 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:05.524001    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-4grxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 10 15:25:05.524407 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:05.524052    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn" podUID="2df55bcd-b9f3-4d4e-8ea6-e3521fc06634" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 10 15:25:06.523371 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:06.523332    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-4grxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 10 15:25:06.523535 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:06.523391    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn" podUID="2df55bcd-b9f3-4d4e-8ea6-e3521fc06634" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 10 15:25:07.527774 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:07.527743    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:25:07.528158 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:07.528015    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:25:07.528612 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:07.528591    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4grxn"
Sep 10 15:25:24.161784 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.161750    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"]
Sep 10 15:25:24.164166 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.164149    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:24.167784 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.167764    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 15:25:24.168991 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.168967    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 10 15:25:24.168991 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.168985    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8dhf4\""
Sep 10 15:25:24.169157 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.168998    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 15:25:24.178542 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.178512    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"]
Sep 10 15:25:24.300045 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.300012    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87a4b013-ca4c-46a0-8995-7d1cf4efc652-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pd52n\" (UID: \"87a4b013-ca4c-46a0-8995-7d1cf4efc652\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:24.300212 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.300066    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87a4b013-ca4c-46a0-8995-7d1cf4efc652-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pd52n\" (UID: \"87a4b013-ca4c-46a0-8995-7d1cf4efc652\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:24.300212 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.300125    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87a4b013-ca4c-46a0-8995-7d1cf4efc652-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pd52n\" (UID: \"87a4b013-ca4c-46a0-8995-7d1cf4efc652\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:24.300212 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.300180    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87a4b013-ca4c-46a0-8995-7d1cf4efc652-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pd52n\" (UID: \"87a4b013-ca4c-46a0-8995-7d1cf4efc652\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:24.300212 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.300202    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87a4b013-ca4c-46a0-8995-7d1cf4efc652-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pd52n\" (UID: \"87a4b013-ca4c-46a0-8995-7d1cf4efc652\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:24.300368 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.300302    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvkmg\" (UniqueName: \"kubernetes.io/projected/87a4b013-ca4c-46a0-8995-7d1cf4efc652-kube-api-access-cvkmg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pd52n\" (UID: \"87a4b013-ca4c-46a0-8995-7d1cf4efc652\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:24.400873 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.400834    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87a4b013-ca4c-46a0-8995-7d1cf4efc652-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pd52n\" (UID: \"87a4b013-ca4c-46a0-8995-7d1cf4efc652\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:24.401066 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.400884    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvkmg\" (UniqueName: \"kubernetes.io/projected/87a4b013-ca4c-46a0-8995-7d1cf4efc652-kube-api-access-cvkmg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pd52n\" (UID: \"87a4b013-ca4c-46a0-8995-7d1cf4efc652\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:24.401066 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.400912    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87a4b013-ca4c-46a0-8995-7d1cf4efc652-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pd52n\" (UID: \"87a4b013-ca4c-46a0-8995-7d1cf4efc652\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:24.401066 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.400957    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87a4b013-ca4c-46a0-8995-7d1cf4efc652-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pd52n\" (UID: \"87a4b013-ca4c-46a0-8995-7d1cf4efc652\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:24.401236 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.401073    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87a4b013-ca4c-46a0-8995-7d1cf4efc652-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pd52n\" (UID: \"87a4b013-ca4c-46a0-8995-7d1cf4efc652\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:24.401236 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.401194    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87a4b013-ca4c-46a0-8995-7d1cf4efc652-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pd52n\" (UID: \"87a4b013-ca4c-46a0-8995-7d1cf4efc652\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:24.401482 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.401456    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87a4b013-ca4c-46a0-8995-7d1cf4efc652-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pd52n\" (UID: \"87a4b013-ca4c-46a0-8995-7d1cf4efc652\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:24.401482 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.401476    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87a4b013-ca4c-46a0-8995-7d1cf4efc652-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pd52n\" (UID: \"87a4b013-ca4c-46a0-8995-7d1cf4efc652\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:24.401606 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.401532    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87a4b013-ca4c-46a0-8995-7d1cf4efc652-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pd52n\" (UID: \"87a4b013-ca4c-46a0-8995-7d1cf4efc652\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:24.403153 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.403136    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87a4b013-ca4c-46a0-8995-7d1cf4efc652-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pd52n\" (UID: \"87a4b013-ca4c-46a0-8995-7d1cf4efc652\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:24.403512 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.403494    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87a4b013-ca4c-46a0-8995-7d1cf4efc652-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pd52n\" (UID: \"87a4b013-ca4c-46a0-8995-7d1cf4efc652\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:24.410023 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.410004    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvkmg\" (UniqueName: \"kubernetes.io/projected/87a4b013-ca4c-46a0-8995-7d1cf4efc652-kube-api-access-cvkmg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pd52n\" (UID: \"87a4b013-ca4c-46a0-8995-7d1cf4efc652\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:24.474947 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.474855    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:24.751594 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:24.751566    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"]
Sep 10 15:25:24.752577 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:25:24.752553    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87a4b013_ca4c_46a0_8995_7d1cf4efc652.slice/crio-e369a3bf38528df7af722eba76ec93e357e4c54daecfab4ec358fe8ffcb8ea6c WatchSource:0}: Error finding container e369a3bf38528df7af722eba76ec93e357e4c54daecfab4ec358fe8ffcb8ea6c: Status 404 returned error can't find the container with id e369a3bf38528df7af722eba76ec93e357e4c54daecfab4ec358fe8ffcb8ea6c
Sep 10 15:25:25.281703 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:25.281643    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n" event={"ID":"87a4b013-ca4c-46a0-8995-7d1cf4efc652","Type":"ContainerStarted","Data":"e369a3bf38528df7af722eba76ec93e357e4c54daecfab4ec358fe8ffcb8ea6c"}
Sep 10 15:25:26.288656 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:26.288611    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n" event={"ID":"87a4b013-ca4c-46a0-8995-7d1cf4efc652","Type":"ContainerStarted","Data":"2401106f90be9c30d80f862ab2887a2241b4b153008f021055377db62e0e45e9"}
Sep 10 15:25:26.317222 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:26.317171    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n" podStartSLOduration=1.34308652 podStartE2EDuration="2.317154611s" totalImagesPullingTime="974.068091ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:25:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:25:26.316804794 +0000 UTC m=+579.366603301" watchObservedRunningTime="2026-09-10 15:25:26.317154611 +0000 UTC m=+579.366953119"
Sep 10 15:25:34.475136 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:34.475095    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:34.475615 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:34.475173    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:34.487777 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:34.487751    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:35.347727 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:35.347690    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pd52n"
Sep 10 15:25:38.241808 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.241774    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"]
Sep 10 15:25:38.244299 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.244282    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:38.247748 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.247731    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 10 15:25:38.255502 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.255478    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"]
Sep 10 15:25:38.430873 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.430832    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25d5d576-a241-47b7-9abf-6e463f5f354b-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts\" (UID: \"25d5d576-a241-47b7-9abf-6e463f5f354b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:38.431073 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.430923    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25d5d576-a241-47b7-9abf-6e463f5f354b-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts\" (UID: \"25d5d576-a241-47b7-9abf-6e463f5f354b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:38.431073 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.430975    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25d5d576-a241-47b7-9abf-6e463f5f354b-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts\" (UID: \"25d5d576-a241-47b7-9abf-6e463f5f354b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:38.431369 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.431090    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25d5d576-a241-47b7-9abf-6e463f5f354b-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts\" (UID: \"25d5d576-a241-47b7-9abf-6e463f5f354b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:38.431369 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.431117    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqhkn\" (UniqueName: \"kubernetes.io/projected/25d5d576-a241-47b7-9abf-6e463f5f354b-kube-api-access-qqhkn\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts\" (UID: \"25d5d576-a241-47b7-9abf-6e463f5f354b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:38.431369 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.431158    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25d5d576-a241-47b7-9abf-6e463f5f354b-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts\" (UID: \"25d5d576-a241-47b7-9abf-6e463f5f354b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:38.531844 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.531751    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25d5d576-a241-47b7-9abf-6e463f5f354b-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts\" (UID: \"25d5d576-a241-47b7-9abf-6e463f5f354b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:38.531844 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.531791    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqhkn\" (UniqueName: \"kubernetes.io/projected/25d5d576-a241-47b7-9abf-6e463f5f354b-kube-api-access-qqhkn\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts\" (UID: \"25d5d576-a241-47b7-9abf-6e463f5f354b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:38.531844 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.531829    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25d5d576-a241-47b7-9abf-6e463f5f354b-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts\" (UID: \"25d5d576-a241-47b7-9abf-6e463f5f354b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:38.532164 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.531870    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25d5d576-a241-47b7-9abf-6e463f5f354b-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts\" (UID: \"25d5d576-a241-47b7-9abf-6e463f5f354b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:38.532164 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.531953    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25d5d576-a241-47b7-9abf-6e463f5f354b-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts\" (UID: \"25d5d576-a241-47b7-9abf-6e463f5f354b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:38.532164 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.531980    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25d5d576-a241-47b7-9abf-6e463f5f354b-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts\" (UID: \"25d5d576-a241-47b7-9abf-6e463f5f354b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:38.532332 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.532259    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25d5d576-a241-47b7-9abf-6e463f5f354b-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts\" (UID: \"25d5d576-a241-47b7-9abf-6e463f5f354b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:38.532332 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.532297    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25d5d576-a241-47b7-9abf-6e463f5f354b-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts\" (UID: \"25d5d576-a241-47b7-9abf-6e463f5f354b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:38.532419 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.532347    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25d5d576-a241-47b7-9abf-6e463f5f354b-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts\" (UID: \"25d5d576-a241-47b7-9abf-6e463f5f354b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:38.534007 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.533989    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25d5d576-a241-47b7-9abf-6e463f5f354b-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts\" (UID: \"25d5d576-a241-47b7-9abf-6e463f5f354b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:38.534499 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.534476    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25d5d576-a241-47b7-9abf-6e463f5f354b-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts\" (UID: \"25d5d576-a241-47b7-9abf-6e463f5f354b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:38.540880 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.540853    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqhkn\" (UniqueName: \"kubernetes.io/projected/25d5d576-a241-47b7-9abf-6e463f5f354b-kube-api-access-qqhkn\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts\" (UID: \"25d5d576-a241-47b7-9abf-6e463f5f354b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:38.554748 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.554721    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:38.835515 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:38.835491    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"]
Sep 10 15:25:38.837129 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:25:38.837095    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d5d576_a241_47b7_9abf_6e463f5f354b.slice/crio-018b0c9d726fe1cec9e7b9c42c20b4d30dab6c07e7b95ea01c779fe7b1c8b5aa WatchSource:0}: Error finding container 018b0c9d726fe1cec9e7b9c42c20b4d30dab6c07e7b95ea01c779fe7b1c8b5aa: Status 404 returned error can't find the container with id 018b0c9d726fe1cec9e7b9c42c20b4d30dab6c07e7b95ea01c779fe7b1c8b5aa
Sep 10 15:25:39.359491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:39.359457    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts" event={"ID":"25d5d576-a241-47b7-9abf-6e463f5f354b","Type":"ContainerStarted","Data":"b6d3ca75b1ab7d65a2e30fab5cd9f88870d5faff833cf913e9e4e192c6dc3b99"}
Sep 10 15:25:39.359874 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:39.359505    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts" event={"ID":"25d5d576-a241-47b7-9abf-6e463f5f354b","Type":"ContainerStarted","Data":"018b0c9d726fe1cec9e7b9c42c20b4d30dab6c07e7b95ea01c779fe7b1c8b5aa"}
Sep 10 15:25:39.379984 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:39.379917    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts" podStartSLOduration=1.1884681320000001 podStartE2EDuration="1.379901847s" totalImagesPullingTime="191.433715ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:25:39.378095547 +0000 UTC m=+592.427894056" watchObservedRunningTime="2026-09-10 15:25:39.379901847 +0000 UTC m=+592.429700355"
Sep 10 15:25:47.357440 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:47.357409    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/2.log"
Sep 10 15:25:47.357853 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:47.357665    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/2.log"
Sep 10 15:25:48.555308 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:48.555250    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:48.555734 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:48.555333    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:48.567942 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:48.567914    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:25:49.430905 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:25:49.430868    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts"
Sep 10 15:27:28.343085 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.343045    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"]
Sep 10 15:27:28.347178 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.347151    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.350421 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.350399    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-229c42-openshift-default-dockercfg-kbv8l\""
Sep 10 15:27:28.360592 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.360564    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"]
Sep 10 15:27:28.411680 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.411640    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-podinfo\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.411868 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.411690    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-data\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.411868 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.411763    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-token\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.411868 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.411802    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-envoy\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.411868 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.411821    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l89qd\" (UniqueName: \"kubernetes.io/projected/ee9fd498-cc64-44be-8c15-59583e6796cb-kube-api-access-l89qd\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.412086 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.411883    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-workload-socket\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.412086 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.411916    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-credential-socket\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.412086 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.411955    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-workload-certs\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.412086 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.411983    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee9fd498-cc64-44be-8c15-59583e6796cb-istiod-ca-cert\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.512651 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.512617    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-envoy\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.512825 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.512656    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l89qd\" (UniqueName: \"kubernetes.io/projected/ee9fd498-cc64-44be-8c15-59583e6796cb-kube-api-access-l89qd\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.512825 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.512721    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-workload-socket\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.512825 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.512753    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-credential-socket\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.512825 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.512778    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-workload-certs\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.512825 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.512814    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee9fd498-cc64-44be-8c15-59583e6796cb-istiod-ca-cert\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.513144 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.512858    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-podinfo\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.513144 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.512895    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-data\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.513144 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.512951    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-token\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.513307 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.513190    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-credential-socket\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.513364 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.513342    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-workload-certs\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.513423 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.513371    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-workload-socket\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.513608 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.513585    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-data\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.513894 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.513871    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee9fd498-cc64-44be-8c15-59583e6796cb-istiod-ca-cert\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.515051 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.515030    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-envoy\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.515362 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.515343    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-podinfo\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.521798 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.521774    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-token\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.522044 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.522020    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l89qd\" (UniqueName: \"kubernetes.io/projected/ee9fd498-cc64-44be-8c15-59583e6796cb-kube-api-access-l89qd\") pod \"e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") " pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.657861 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.657766    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:28.938368 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.938338    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"]
Sep 10 15:27:28.939738 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:27:28.939709    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee9fd498_cc64_44be_8c15_59583e6796cb.slice/crio-6eac97b41e60ddd9ab22c2b94b3213557b7b23a993856c4b7fe372ea22883fd9 WatchSource:0}: Error finding container 6eac97b41e60ddd9ab22c2b94b3213557b7b23a993856c4b7fe372ea22883fd9: Status 404 returned error can't find the container with id 6eac97b41e60ddd9ab22c2b94b3213557b7b23a993856c4b7fe372ea22883fd9
Sep 10 15:27:28.941981 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.941951    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:27:28.942058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.942025    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:27:28.942097 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:28.942060    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:27:29.940988 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:29.940951    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn" event={"ID":"ee9fd498-cc64-44be-8c15-59583e6796cb","Type":"ContainerStarted","Data":"36b9758ffa0f8bab0cfb681ad261af7b345ca546075bdbf5e751772b55262fe2"}
Sep 10 15:27:29.941517 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:29.941007    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn" event={"ID":"ee9fd498-cc64-44be-8c15-59583e6796cb","Type":"ContainerStarted","Data":"6eac97b41e60ddd9ab22c2b94b3213557b7b23a993856c4b7fe372ea22883fd9"}
Sep 10 15:27:29.966295 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:29.966234    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn" podStartSLOduration=1.966220268 podStartE2EDuration="1.966220268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:27:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:27:29.965080244 +0000 UTC m=+703.014878765" watchObservedRunningTime="2026-09-10 15:27:29.966220268 +0000 UTC m=+703.016018776"
Sep 10 15:27:30.658165 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:30.658119    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:30.663323 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:30.663295    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:30.946733 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:30.946629    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:30.947594 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:30.947574    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:36.645335 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.645300    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"]
Sep 10 15:27:36.649130 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.649109    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.652089 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.652068    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-2e2b69-openshift-default-dockercfg-6v8wk\""
Sep 10 15:27:36.665663 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.665628    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"]
Sep 10 15:27:36.689532 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.689489    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-data\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.689735 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.689559    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-envoy\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.689735 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.689698    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-workload-certs\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.689842 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.689740    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istiod-ca-cert\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.689842 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.689792    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-workload-socket\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.689842 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.689819    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-token\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.690022 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.689860    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kps4z\" (UniqueName: \"kubernetes.io/projected/872d1243-323b-4d7c-ab11-50e6f8b68dd4-kube-api-access-kps4z\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.690022 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.689900    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-podinfo\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.690022 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.689990    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-credential-socket\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.791347 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.791299    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-credential-socket\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.791530 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.791360    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-data\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.791530 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.791385    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-envoy\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.791530 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.791436    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-workload-certs\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.791530 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.791453    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istiod-ca-cert\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.791530 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.791472    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-workload-socket\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.791530 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.791487    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-token\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.791530 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.791509    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kps4z\" (UniqueName: \"kubernetes.io/projected/872d1243-323b-4d7c-ab11-50e6f8b68dd4-kube-api-access-kps4z\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.791893 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.791741    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-podinfo\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.791893 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.791763    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-credential-socket\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.791893 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.791812    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-data\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.792092 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.791996    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-workload-certs\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.792152 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.792102    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-workload-socket\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.792152 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.792138    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istiod-ca-cert\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.793686 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.793665    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-envoy\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.794183 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.794166    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-podinfo\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.800370 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.800348    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-token\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.800480 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.800412    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kps4z\" (UniqueName: \"kubernetes.io/projected/872d1243-323b-4d7c-ab11-50e6f8b68dd4-kube-api-access-kps4z\") pod \"e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") " pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:36.959713 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:36.959620    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:37.012607 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.012567    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"]
Sep 10 15:27:37.017338 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.016798    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.020156 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.020072    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8b74e71b-openshift-default-dockercfg-xq97g\""
Sep 10 15:27:37.031276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.029271    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"]
Sep 10 15:27:37.094944 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.094891    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-istio-data\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.095151 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.094973    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct99x\" (UniqueName: \"kubernetes.io/projected/09ec087a-1da8-412d-8316-24110d16fd5a-kube-api-access-ct99x\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.095151 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.095017    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ec087a-1da8-412d-8316-24110d16fd5a-istiod-ca-cert\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.095151 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.095125    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ec087a-1da8-412d-8316-24110d16fd5a-istio-token\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.095288 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.095187    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-credential-socket\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.095288 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.095237    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-workload-certs\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.095288 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.095283    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-workload-socket\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.095432 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.095301    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-istio-envoy\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.095432 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.095319    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ec087a-1da8-412d-8316-24110d16fd5a-istio-podinfo\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.196508 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.196467    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-istio-data\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.196508 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.196512    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct99x\" (UniqueName: \"kubernetes.io/projected/09ec087a-1da8-412d-8316-24110d16fd5a-kube-api-access-ct99x\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.196720 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.196542    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ec087a-1da8-412d-8316-24110d16fd5a-istiod-ca-cert\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.196720 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.196584    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ec087a-1da8-412d-8316-24110d16fd5a-istio-token\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.196720 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.196638    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-credential-socket\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.196720 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.196665    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-workload-certs\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.196720 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.196711    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-workload-socket\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.197024 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.196832    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-istio-envoy\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.197024 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.196879    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ec087a-1da8-412d-8316-24110d16fd5a-istio-podinfo\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.197024 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.196982    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-istio-data\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.197024 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.197017    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-workload-socket\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.197211 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.197107    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-credential-socket\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.197306 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.197289    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ec087a-1da8-412d-8316-24110d16fd5a-istiod-ca-cert\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.197344 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.197289    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-workload-certs\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.199072 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.199050    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-istio-envoy\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.199287 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.199270    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ec087a-1da8-412d-8316-24110d16fd5a-istio-podinfo\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.213438 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.213362    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ec087a-1da8-412d-8316-24110d16fd5a-istio-token\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.213695 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.213676    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct99x\" (UniqueName: \"kubernetes.io/projected/09ec087a-1da8-412d-8316-24110d16fd5a-kube-api-access-ct99x\") pod \"e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") " pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.286826 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.286784    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"]
Sep 10 15:27:37.290562 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:27:37.290531    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod872d1243_323b_4d7c_ab11_50e6f8b68dd4.slice/crio-255c2735703ede2f79ea9d2af44a7b8f6f3a71449746f71b7f2f7ad932f3fda0 WatchSource:0}: Error finding container 255c2735703ede2f79ea9d2af44a7b8f6f3a71449746f71b7f2f7ad932f3fda0: Status 404 returned error can't find the container with id 255c2735703ede2f79ea9d2af44a7b8f6f3a71449746f71b7f2f7ad932f3fda0
Sep 10 15:27:37.292977 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.292945    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:27:37.293039 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.293012    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:27:37.293080 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.293041    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:27:37.333844 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.333811    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:37.613510 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.613482    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"]
Sep 10 15:27:37.615992 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:27:37.615909    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09ec087a_1da8_412d_8316_24110d16fd5a.slice/crio-a776793d400046acd5eda7bc1791fb464ce4a191af2100a58a12f1cc4adcd9c9 WatchSource:0}: Error finding container a776793d400046acd5eda7bc1791fb464ce4a191af2100a58a12f1cc4adcd9c9: Status 404 returned error can't find the container with id a776793d400046acd5eda7bc1791fb464ce4a191af2100a58a12f1cc4adcd9c9
Sep 10 15:27:37.618307 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.618275    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:27:37.618390 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.618337    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:27:37.618390 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.618363    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:27:37.987563 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.987449    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl" event={"ID":"872d1243-323b-4d7c-ab11-50e6f8b68dd4","Type":"ContainerStarted","Data":"8a7043c4777df9afc9e691fec6d75a0d6c24e8757d2040996568f09c0e097e99"}
Sep 10 15:27:37.987563 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.987527    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl" event={"ID":"872d1243-323b-4d7c-ab11-50e6f8b68dd4","Type":"ContainerStarted","Data":"255c2735703ede2f79ea9d2af44a7b8f6f3a71449746f71b7f2f7ad932f3fda0"}
Sep 10 15:27:37.989373 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.989333    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4" event={"ID":"09ec087a-1da8-412d-8316-24110d16fd5a","Type":"ContainerStarted","Data":"e158c18740a7b802174cf6db8746f47b9d9f7547ff3e9cf7e08e61b7d49f6288"}
Sep 10 15:27:37.989484 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:37.989398    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4" event={"ID":"09ec087a-1da8-412d-8316-24110d16fd5a","Type":"ContainerStarted","Data":"a776793d400046acd5eda7bc1791fb464ce4a191af2100a58a12f1cc4adcd9c9"}
Sep 10 15:27:38.013183 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:38.013132    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl" podStartSLOduration=2.013113373 podStartE2EDuration="2.013113373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:27:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:27:38.009848892 +0000 UTC m=+711.059647401" watchObservedRunningTime="2026-09-10 15:27:38.013113373 +0000 UTC m=+711.062911939"
Sep 10 15:27:38.031479 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:38.031414    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4" podStartSLOduration=2.031390741 podStartE2EDuration="2.031390741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:27:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:27:38.030058429 +0000 UTC m=+711.079856938" watchObservedRunningTime="2026-09-10 15:27:38.031390741 +0000 UTC m=+711.081189250"
Sep 10 15:27:38.333963 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:38.333904    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:38.339352 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:38.339324    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:38.960764 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:38.960727    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:38.965578 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:38.965552    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:39.001537 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:39.001502    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:39.002036 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:39.001594    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:39.002514 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:39.002489    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:39.002631 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:39.002543    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:51.090267 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:51.090177    2574 generic.go:356] "Generic (PLEG): container finished" podID="ee9fd498-cc64-44be-8c15-59583e6796cb" containerID="36b9758ffa0f8bab0cfb681ad261af7b345ca546075bdbf5e751772b55262fe2" exitCode=0
Sep 10 15:27:51.090660 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:51.090293    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn" event={"ID":"ee9fd498-cc64-44be-8c15-59583e6796cb","Type":"ContainerDied","Data":"36b9758ffa0f8bab0cfb681ad261af7b345ca546075bdbf5e751772b55262fe2"}
Sep 10 15:27:51.090660 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:51.090657    2574 scope.go:117] "RemoveContainer" containerID="36b9758ffa0f8bab0cfb681ad261af7b345ca546075bdbf5e751772b55262fe2"
Sep 10 15:27:51.091843 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:51.091813    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:27:51.091914 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:51.091899    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:27:51.091986 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:51.091971    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:27:52.105659 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:52.105611    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn" event={"ID":"ee9fd498-cc64-44be-8c15-59583e6796cb","Type":"ContainerStarted","Data":"e7fe845a5c80994f46729a87c35d19e08ee5cb433c81f6a4d48f6b95a9402daa"}
Sep 10 15:27:52.658757 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:52.658653    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:52.658757 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:52.658704    2574 patch_prober.go:28] interesting pod/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 10 15:27:52.659051 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:52.658781    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn" podUID="ee9fd498-cc64-44be-8c15-59583e6796cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 10 15:27:53.659622 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:53.659126    2574 patch_prober.go:28] interesting pod/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 10 15:27:53.659622 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:53.659190    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn" podUID="ee9fd498-cc64-44be-8c15-59583e6796cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 10 15:27:54.658981 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:54.658814    2574 patch_prober.go:28] interesting pod/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 10 15:27:54.658981 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:54.658880    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn" podUID="ee9fd498-cc64-44be-8c15-59583e6796cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 10 15:27:55.043175 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:55.043132    2574 patch_prober.go:28] interesting pod/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 15:27:55.043702 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:55.043212    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4" podUID="09ec087a-1da8-412d-8316-24110d16fd5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 15:27:55.045122 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:55.045075    2574 patch_prober.go:28] interesting pod/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 15:27:55.045247 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:55.045147    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl" podUID="872d1243-323b-4d7c-ab11-50e6f8b68dd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 15:27:55.659079 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:55.659034    2574 patch_prober.go:28] interesting pod/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 10 15:27:55.659280 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:55.659091    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn" podUID="ee9fd498-cc64-44be-8c15-59583e6796cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 10 15:27:56.658790 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:56.658751    2574 patch_prober.go:28] interesting pod/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 10 15:27:56.659247 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:56.658814    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn" podUID="ee9fd498-cc64-44be-8c15-59583e6796cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 10 15:27:57.147653 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.147608    2574 generic.go:356] "Generic (PLEG): container finished" podID="872d1243-323b-4d7c-ab11-50e6f8b68dd4" containerID="8a7043c4777df9afc9e691fec6d75a0d6c24e8757d2040996568f09c0e097e99" exitCode=0
Sep 10 15:27:57.147869 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.147752    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl" event={"ID":"872d1243-323b-4d7c-ab11-50e6f8b68dd4","Type":"ContainerDied","Data":"8a7043c4777df9afc9e691fec6d75a0d6c24e8757d2040996568f09c0e097e99"}
Sep 10 15:27:57.148317 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.148290    2574 scope.go:117] "RemoveContainer" containerID="8a7043c4777df9afc9e691fec6d75a0d6c24e8757d2040996568f09c0e097e99"
Sep 10 15:27:57.150033 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.149977    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:27:57.150140 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.150064    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:27:57.150140 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.150111    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:27:57.151637 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.151608    2574 generic.go:356] "Generic (PLEG): container finished" podID="09ec087a-1da8-412d-8316-24110d16fd5a" containerID="e158c18740a7b802174cf6db8746f47b9d9f7547ff3e9cf7e08e61b7d49f6288" exitCode=0
Sep 10 15:27:57.151729 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.151683    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4" event={"ID":"09ec087a-1da8-412d-8316-24110d16fd5a","Type":"ContainerDied","Data":"e158c18740a7b802174cf6db8746f47b9d9f7547ff3e9cf7e08e61b7d49f6288"}
Sep 10 15:27:57.152139 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.152122    2574 scope.go:117] "RemoveContainer" containerID="e158c18740a7b802174cf6db8746f47b9d9f7547ff3e9cf7e08e61b7d49f6288"
Sep 10 15:27:57.155391 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.155347    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:27:57.155507 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.155437    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:27:57.155507 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.155489    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:27:57.451949 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.451837    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"]
Sep 10 15:27:57.476163 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.476127    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"]
Sep 10 15:27:57.476498 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.476478    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.487952 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.487826    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-50fe56-openshift-default-dockercfg-hld2s\""
Sep 10 15:27:57.623178 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.623120    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-credential-socket\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.623383 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.623278    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jcsh\" (UniqueName: \"kubernetes.io/projected/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-kube-api-access-2jcsh\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.623383 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.623323    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-workload-socket\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.623383 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.623358    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istiod-ca-cert\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.623518 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.623463    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-envoy\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.623568 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.623526    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-data\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.623621 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.623564    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-token\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.623621 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.623610    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-workload-certs\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.623697 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.623634    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-podinfo\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.725098 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.724965    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jcsh\" (UniqueName: \"kubernetes.io/projected/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-kube-api-access-2jcsh\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.725098 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.725054    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-workload-socket\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.725098 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.725092    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istiod-ca-cert\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.725681 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.725151    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-envoy\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.725681 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.725207    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-data\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.725681 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.725238    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-token\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.725681 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.725283    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-workload-certs\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.725681 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.725310    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-podinfo\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.725681 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.725356    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-credential-socket\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.726040 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.725855    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-credential-socket\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.726569 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.726536    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-workload-socket\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.727066 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.727043    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-workload-certs\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.727254 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.727228    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-data\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.727331 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.727261    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istiod-ca-cert\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.732277 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.732227    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-envoy\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.732517 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.732458    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-podinfo\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.738570 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.738514    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-token\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.738691 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.738577    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jcsh\" (UniqueName: \"kubernetes.io/projected/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-kube-api-access-2jcsh\") pod \"e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") " pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:57.801189 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:57.801159    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:58.012365 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:58.012274    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:58.012657 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:58.012601    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:58.013491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:58.013473    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:27:58.125986 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:58.125626    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"]
Sep 10 15:27:58.126337 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:27:58.126299    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd2e99b6_d9e1_41ec_9041_c797d9a4abb2.slice/crio-bee63f98a2b8aaf84d23b55ba42073be06d1f69c99aa4c2d1b4c3400b3eeae69 WatchSource:0}: Error finding container bee63f98a2b8aaf84d23b55ba42073be06d1f69c99aa4c2d1b4c3400b3eeae69: Status 404 returned error can't find the container with id bee63f98a2b8aaf84d23b55ba42073be06d1f69c99aa4c2d1b4c3400b3eeae69
Sep 10 15:27:58.133901 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:58.132596    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:27:58.133901 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:58.132704    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:27:58.133901 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:58.132746    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:27:58.172564 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:58.172534    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4" event={"ID":"09ec087a-1da8-412d-8316-24110d16fd5a","Type":"ContainerStarted","Data":"3084fa5181745f4b985e720cd75522cb4039a3d3beef8e1ec3cf862721062bcb"}
Sep 10 15:27:58.175659 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:58.175629    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl" event={"ID":"872d1243-323b-4d7c-ab11-50e6f8b68dd4","Type":"ContainerStarted","Data":"44a0172bec7d6c28b2abea3f2546b1f6db5e0ec654af239ee2489f75ab832797"}
Sep 10 15:27:58.180335 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:58.180298    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9" event={"ID":"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2","Type":"ContainerStarted","Data":"bee63f98a2b8aaf84d23b55ba42073be06d1f69c99aa4c2d1b4c3400b3eeae69"}
Sep 10 15:27:58.334467 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:58.334423    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:27:58.334687 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:58.334567    2574 patch_prober.go:28] interesting pod/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 15:27:58.334687 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:58.334616    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4" podUID="09ec087a-1da8-412d-8316-24110d16fd5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 15:27:58.961142 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:58.961102    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:27:58.961843 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:58.961817    2574 patch_prober.go:28] interesting pod/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 15:27:58.962033 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:58.962007    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl" podUID="872d1243-323b-4d7c-ab11-50e6f8b68dd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 15:27:59.188297 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:59.188261    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9" event={"ID":"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2","Type":"ContainerStarted","Data":"8c3a54745f5ad1abd7a53517a933bd29a72b1585c4e92a46d07f2e39ab6b14e8"}
Sep 10 15:27:59.213276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:59.213173    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9" podStartSLOduration=2.213158573 podStartE2EDuration="2.213158573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:27:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:27:59.21141905 +0000 UTC m=+732.261217559" watchObservedRunningTime="2026-09-10 15:27:59.213158573 +0000 UTC m=+732.262957080"
Sep 10 15:27:59.334464 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:59.334410    2574 patch_prober.go:28] interesting pod/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 15:27:59.334671 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:59.334488    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4" podUID="09ec087a-1da8-412d-8316-24110d16fd5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 15:27:59.801911 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:59.801879    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:59.807346 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:59.807321    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:27:59.960977 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:59.960904    2574 patch_prober.go:28] interesting pod/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 15:27:59.961191 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:27:59.961000    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl" podUID="872d1243-323b-4d7c-ab11-50e6f8b68dd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 15:28:00.194021 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:00.193943    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:28:00.194825 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:00.194805    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:28:00.351958 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:00.351338    2574 patch_prober.go:28] interesting pod/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 15:28:00.351958 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:00.351401    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4" podUID="09ec087a-1da8-412d-8316-24110d16fd5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 15:28:00.960356 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:00.960303    2574 patch_prober.go:28] interesting pod/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 15:28:00.960682 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:00.960385    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl" podUID="872d1243-323b-4d7c-ab11-50e6f8b68dd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 15:28:01.335310 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:01.335271    2574 patch_prober.go:28] interesting pod/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 15:28:01.335885 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:01.335849    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4" podUID="09ec087a-1da8-412d-8316-24110d16fd5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 15:28:01.960130 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:01.960089    2574 patch_prober.go:28] interesting pod/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 15:28:01.960427 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:01.960395    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl" podUID="872d1243-323b-4d7c-ab11-50e6f8b68dd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 15:28:02.334475 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:02.334430    2574 patch_prober.go:28] interesting pod/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 15:28:02.334692 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:02.334498    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4" podUID="09ec087a-1da8-412d-8316-24110d16fd5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 15:28:02.961068 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:02.961025    2574 patch_prober.go:28] interesting pod/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 15:28:02.961680 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:02.961622    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl" podUID="872d1243-323b-4d7c-ab11-50e6f8b68dd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 15:28:03.335131 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:03.335090    2574 patch_prober.go:28] interesting pod/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 15:28:03.335346 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:03.335159    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4" podUID="09ec087a-1da8-412d-8316-24110d16fd5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 15:28:03.964859 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:03.964822    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:28:03.965382 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:03.965130    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:28:03.965970 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:03.965923    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:28:04.337613 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:04.337585    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:28:04.337874 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:04.337852    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:28:04.338504 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:04.338485    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:28:04.841853 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:04.841817    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b74e71b-f8lcx"]
Sep 10 15:28:04.844735 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:04.844714    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b74e71b-f8lcx"
Sep 10 15:28:04.847642 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:04.847619    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 15:28:04.847736 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:04.847688    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zzl2g\""
Sep 10 15:28:04.854400 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:04.854375    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b74e71b-f8lcx"]
Sep 10 15:28:05.035999 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:05.035912    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/241f2a1a-4896-4b2f-a304-01d0199252a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8b74e71b-f8lcx\" (UID: \"241f2a1a-4896-4b2f-a304-01d0199252a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b74e71b-f8lcx"
Sep 10 15:28:05.136977 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:05.136852    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/241f2a1a-4896-4b2f-a304-01d0199252a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8b74e71b-f8lcx\" (UID: \"241f2a1a-4896-4b2f-a304-01d0199252a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b74e71b-f8lcx"
Sep 10 15:28:05.137510 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:05.137490    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/241f2a1a-4896-4b2f-a304-01d0199252a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8b74e71b-f8lcx\" (UID: \"241f2a1a-4896-4b2f-a304-01d0199252a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b74e71b-f8lcx"
Sep 10 15:28:05.156795 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:05.156764    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b74e71b-f8lcx"
Sep 10 15:28:05.432743 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:05.432718    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b74e71b-f8lcx"]
Sep 10 15:28:05.433623 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:28:05.433598    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod241f2a1a_4896_4b2f_a304_01d0199252a0.slice/crio-1b9f920847c8ecb933bdebe5b36575781c62ec1d2e3542ae3e0ece43e9d80a93 WatchSource:0}: Error finding container 1b9f920847c8ecb933bdebe5b36575781c62ec1d2e3542ae3e0ece43e9d80a93: Status 404 returned error can't find the container with id 1b9f920847c8ecb933bdebe5b36575781c62ec1d2e3542ae3e0ece43e9d80a93
Sep 10 15:28:05.435442 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:05.435425    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 15:28:06.232642 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:06.232604    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b74e71b-f8lcx" event={"ID":"241f2a1a-4896-4b2f-a304-01d0199252a0","Type":"ContainerStarted","Data":"1b9f920847c8ecb933bdebe5b36575781c62ec1d2e3542ae3e0ece43e9d80a93"}
Sep 10 15:28:08.248983 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:08.248898    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b74e71b-f8lcx" event={"ID":"241f2a1a-4896-4b2f-a304-01d0199252a0","Type":"ContainerStarted","Data":"10a544e95d0b4a51784a38bb0d8bb94d511a4f156169e5a76855b2963d21c13b"}
Sep 10 15:28:08.268622 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:08.268566    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b74e71b-f8lcx" podStartSLOduration=1.8252261889999999 podStartE2EDuration="4.268550949s" totalImagesPullingTime="2.44332476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:28:08.265787097 +0000 UTC m=+741.315585607" watchObservedRunningTime="2026-09-10 15:28:08.268550949 +0000 UTC m=+741.318349456"
Sep 10 15:28:09.257575 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:09.257541    2574 generic.go:356] "Generic (PLEG): container finished" podID="241f2a1a-4896-4b2f-a304-01d0199252a0" containerID="10a544e95d0b4a51784a38bb0d8bb94d511a4f156169e5a76855b2963d21c13b" exitCode=0
Sep 10 15:28:09.257969 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:09.257596    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b74e71b-f8lcx" event={"ID":"241f2a1a-4896-4b2f-a304-01d0199252a0","Type":"ContainerDied","Data":"10a544e95d0b4a51784a38bb0d8bb94d511a4f156169e5a76855b2963d21c13b"}
Sep 10 15:28:10.419884 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:10.419859    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b74e71b-f8lcx"
Sep 10 15:28:10.493234 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:10.493196    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/241f2a1a-4896-4b2f-a304-01d0199252a0-maas-api-service-ca\") pod \"241f2a1a-4896-4b2f-a304-01d0199252a0\" (UID: \"241f2a1a-4896-4b2f-a304-01d0199252a0\") "
Sep 10 15:28:10.493589 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:10.493565    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/241f2a1a-4896-4b2f-a304-01d0199252a0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "241f2a1a-4896-4b2f-a304-01d0199252a0" (UID: "241f2a1a-4896-4b2f-a304-01d0199252a0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:28:10.594708 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:10.594675    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/241f2a1a-4896-4b2f-a304-01d0199252a0-maas-api-service-ca\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:28:11.272041 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:11.272010    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b74e71b-f8lcx"
Sep 10 15:28:11.272218 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:11.272018    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b74e71b-f8lcx" event={"ID":"241f2a1a-4896-4b2f-a304-01d0199252a0","Type":"ContainerDied","Data":"1b9f920847c8ecb933bdebe5b36575781c62ec1d2e3542ae3e0ece43e9d80a93"}
Sep 10 15:28:11.272218 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:11.272132    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b9f920847c8ecb933bdebe5b36575781c62ec1d2e3542ae3e0ece43e9d80a93"
Sep 10 15:28:21.332917 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:21.332882    2574 generic.go:356] "Generic (PLEG): container finished" podID="cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" containerID="8c3a54745f5ad1abd7a53517a933bd29a72b1585c4e92a46d07f2e39ab6b14e8" exitCode=0
Sep 10 15:28:21.332917 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:21.332946    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9" event={"ID":"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2","Type":"ContainerDied","Data":"8c3a54745f5ad1abd7a53517a933bd29a72b1585c4e92a46d07f2e39ab6b14e8"}
Sep 10 15:28:21.333410 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:21.333325    2574 scope.go:117] "RemoveContainer" containerID="8c3a54745f5ad1abd7a53517a933bd29a72b1585c4e92a46d07f2e39ab6b14e8"
Sep 10 15:28:21.334392 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:21.334362    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:28:21.334462 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:21.334433    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:28:21.334505 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:21.334462    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:28:21.890338 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:21.890289    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b74e71b-f8lcx"]
Sep 10 15:28:21.892896 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:21.892869    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b74e71b-f8lcx"]
Sep 10 15:28:22.025457 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:22.025418    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"]
Sep 10 15:28:22.025689 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:22.025663    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4" podUID="09ec087a-1da8-412d-8316-24110d16fd5a" containerName="istio-proxy" containerID="cri-o://3084fa5181745f4b985e720cd75522cb4039a3d3beef8e1ec3cf862721062bcb" gracePeriod=30
Sep 10 15:28:22.344374 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:22.344323    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9" event={"ID":"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2","Type":"ContainerStarted","Data":"e0663a07ccf76923e4bef5be5404ab6850451a98349d066d563908c1287dcc5f"}
Sep 10 15:28:22.801614 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:22.801581    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:28:22.801820 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:22.801795    2574 patch_prober.go:28] interesting pod/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 15:28:22.801868 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:22.801848    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9" podUID="cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 15:28:22.975983 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:22.975950    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"]
Sep 10 15:28:22.976479 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:22.976453    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="241f2a1a-4896-4b2f-a304-01d0199252a0" containerName="revoke-keys"
Sep 10 15:28:22.976479 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:22.976479    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="241f2a1a-4896-4b2f-a304-01d0199252a0" containerName="revoke-keys"
Sep 10 15:28:22.976676 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:22.976600    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="241f2a1a-4896-4b2f-a304-01d0199252a0" containerName="revoke-keys"
Sep 10 15:28:22.979194 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:22.979174    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:22.981783 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:22.981765    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-8d054c9d-gw-openshift-default-dockercfg-kvftt\""
Sep 10 15:28:22.992753 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:22.992725    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"]
Sep 10 15:28:23.126774 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.126681    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-workload-certs\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.126774 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.126731    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-podinfo\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.126774 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.126755    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-token\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.127039 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.126825    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-envoy\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.127039 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.126889    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtnd7\" (UniqueName: \"kubernetes.io/projected/940ca4f5-54c8-4837-9f54-b001e2402ad4-kube-api-access-rtnd7\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.127039 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.126918    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-credential-socket\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.127039 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.126963    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-data\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.127039 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.126979    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/940ca4f5-54c8-4837-9f54-b001e2402ad4-istiod-ca-cert\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.127202 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.127055    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-workload-socket\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.228537 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.228485    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-workload-socket\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.228758 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.228585    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-workload-certs\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.228758 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.228632    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-podinfo\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.228758 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.228667    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-token\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.228758 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.228711    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-envoy\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.229046 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.228775    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtnd7\" (UniqueName: \"kubernetes.io/projected/940ca4f5-54c8-4837-9f54-b001e2402ad4-kube-api-access-rtnd7\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.229046 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.228819    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-credential-socket\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.229046 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.228848    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-data\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.229046 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.228873    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/940ca4f5-54c8-4837-9f54-b001e2402ad4-istiod-ca-cert\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.229525 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.229496    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-workload-socket\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.229768 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.229743    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/940ca4f5-54c8-4837-9f54-b001e2402ad4-istiod-ca-cert\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.232960 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.230163    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-workload-certs\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.232960 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.230381    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-credential-socket\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.232960 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.230623    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-data\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.240949 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.234790    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-podinfo\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.240949 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.239463    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtnd7\" (UniqueName: \"kubernetes.io/projected/940ca4f5-54c8-4837-9f54-b001e2402ad4-kube-api-access-rtnd7\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.240949 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.239884    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-token\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.246231 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.246196    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-envoy\") pod \"e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") " pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.292666 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.292624    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:23.410058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.409976    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="241f2a1a-4896-4b2f-a304-01d0199252a0" path="/var/lib/kubelet/pods/241f2a1a-4896-4b2f-a304-01d0199252a0/volumes"
Sep 10 15:28:23.612901 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.612862    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"]
Sep 10 15:28:23.613559 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:28:23.613535    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod940ca4f5_54c8_4837_9f54_b001e2402ad4.slice/crio-04907303b08f830c1c889a58cfed2e3bd0976834b54c3d931320e7653d78defe WatchSource:0}: Error finding container 04907303b08f830c1c889a58cfed2e3bd0976834b54c3d931320e7653d78defe: Status 404 returned error can't find the container with id 04907303b08f830c1c889a58cfed2e3bd0976834b54c3d931320e7653d78defe
Sep 10 15:28:23.615794 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.615762    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:28:23.615864 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.615828    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:28:23.615898 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.615865    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:28:23.801643 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.801613    2574 patch_prober.go:28] interesting pod/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 15:28:23.801852 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:23.801664    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9" podUID="cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 15:28:24.361764 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:24.361722    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm" event={"ID":"940ca4f5-54c8-4837-9f54-b001e2402ad4","Type":"ContainerStarted","Data":"1f88428fe2bea318b837b678c39a97ff511bed9d2458fe213e026af7150a0d74"}
Sep 10 15:28:24.361966 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:24.361781    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm" event={"ID":"940ca4f5-54c8-4837-9f54-b001e2402ad4","Type":"ContainerStarted","Data":"04907303b08f830c1c889a58cfed2e3bd0976834b54c3d931320e7653d78defe"}
Sep 10 15:28:24.393942 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:24.393875    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm" podStartSLOduration=2.3938573180000002 podStartE2EDuration="2.393857318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:28:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:28:24.392205862 +0000 UTC m=+757.442004369" watchObservedRunningTime="2026-09-10 15:28:24.393857318 +0000 UTC m=+757.443655827"
Sep 10 15:28:24.802561 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:24.802515    2574 patch_prober.go:28] interesting pod/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 15:28:24.803077 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:24.802597    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9" podUID="cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 15:28:25.293699 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:25.293666    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:25.299114 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:25.299086    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:25.368901 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:25.368870    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:25.369785 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:25.369766    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:25.802502 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:25.802466    2574 patch_prober.go:28] interesting pod/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 15:28:25.802695 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:25.802522    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9" podUID="cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 15:28:26.802285 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:26.802240    2574 patch_prober.go:28] interesting pod/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 15:28:26.802453 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:26.802321    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9" podUID="cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 15:28:27.324179 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.324104    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:28:27.387228 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.387196    2574 generic.go:356] "Generic (PLEG): container finished" podID="09ec087a-1da8-412d-8316-24110d16fd5a" containerID="3084fa5181745f4b985e720cd75522cb4039a3d3beef8e1ec3cf862721062bcb" exitCode=0
Sep 10 15:28:27.387423 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.387253    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"
Sep 10 15:28:27.387423 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.387291    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4" event={"ID":"09ec087a-1da8-412d-8316-24110d16fd5a","Type":"ContainerDied","Data":"3084fa5181745f4b985e720cd75522cb4039a3d3beef8e1ec3cf862721062bcb"}
Sep 10 15:28:27.387423 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.387360    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4" event={"ID":"09ec087a-1da8-412d-8316-24110d16fd5a","Type":"ContainerDied","Data":"a776793d400046acd5eda7bc1791fb464ce4a191af2100a58a12f1cc4adcd9c9"}
Sep 10 15:28:27.387423 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.387376    2574 scope.go:117] "RemoveContainer" containerID="3084fa5181745f4b985e720cd75522cb4039a3d3beef8e1ec3cf862721062bcb"
Sep 10 15:28:27.399711 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.399663    2574 scope.go:117] "RemoveContainer" containerID="e158c18740a7b802174cf6db8746f47b9d9f7547ff3e9cf7e08e61b7d49f6288"
Sep 10 15:28:27.409896 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.409876    2574 scope.go:117] "RemoveContainer" containerID="3084fa5181745f4b985e720cd75522cb4039a3d3beef8e1ec3cf862721062bcb"
Sep 10 15:28:27.410170 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:28:27.410151    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3084fa5181745f4b985e720cd75522cb4039a3d3beef8e1ec3cf862721062bcb\": container with ID starting with 3084fa5181745f4b985e720cd75522cb4039a3d3beef8e1ec3cf862721062bcb not found: ID does not exist" containerID="3084fa5181745f4b985e720cd75522cb4039a3d3beef8e1ec3cf862721062bcb"
Sep 10 15:28:27.410245 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.410178    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3084fa5181745f4b985e720cd75522cb4039a3d3beef8e1ec3cf862721062bcb"} err="failed to get container status \"3084fa5181745f4b985e720cd75522cb4039a3d3beef8e1ec3cf862721062bcb\": rpc error: code = NotFound desc = could not find container \"3084fa5181745f4b985e720cd75522cb4039a3d3beef8e1ec3cf862721062bcb\": container with ID starting with 3084fa5181745f4b985e720cd75522cb4039a3d3beef8e1ec3cf862721062bcb not found: ID does not exist"
Sep 10 15:28:27.410245 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.410194    2574 scope.go:117] "RemoveContainer" containerID="e158c18740a7b802174cf6db8746f47b9d9f7547ff3e9cf7e08e61b7d49f6288"
Sep 10 15:28:27.410451 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:28:27.410437    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e158c18740a7b802174cf6db8746f47b9d9f7547ff3e9cf7e08e61b7d49f6288\": container with ID starting with e158c18740a7b802174cf6db8746f47b9d9f7547ff3e9cf7e08e61b7d49f6288 not found: ID does not exist" containerID="e158c18740a7b802174cf6db8746f47b9d9f7547ff3e9cf7e08e61b7d49f6288"
Sep 10 15:28:27.410491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.410455    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e158c18740a7b802174cf6db8746f47b9d9f7547ff3e9cf7e08e61b7d49f6288"} err="failed to get container status \"e158c18740a7b802174cf6db8746f47b9d9f7547ff3e9cf7e08e61b7d49f6288\": rpc error: code = NotFound desc = could not find container \"e158c18740a7b802174cf6db8746f47b9d9f7547ff3e9cf7e08e61b7d49f6288\": container with ID starting with e158c18740a7b802174cf6db8746f47b9d9f7547ff3e9cf7e08e61b7d49f6288 not found: ID does not exist"
Sep 10 15:28:27.489332 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.489301    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-credential-socket\") pod \"09ec087a-1da8-412d-8316-24110d16fd5a\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") "
Sep 10 15:28:27.489525 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.489355    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ec087a-1da8-412d-8316-24110d16fd5a-istio-token\") pod \"09ec087a-1da8-412d-8316-24110d16fd5a\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") "
Sep 10 15:28:27.489525 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.489390    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ec087a-1da8-412d-8316-24110d16fd5a-istio-podinfo\") pod \"09ec087a-1da8-412d-8316-24110d16fd5a\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") "
Sep 10 15:28:27.489525 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.489428    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ec087a-1da8-412d-8316-24110d16fd5a-istiod-ca-cert\") pod \"09ec087a-1da8-412d-8316-24110d16fd5a\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") "
Sep 10 15:28:27.489525 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.489445    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-workload-socket\") pod \"09ec087a-1da8-412d-8316-24110d16fd5a\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") "
Sep 10 15:28:27.489525 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.489476    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-istio-envoy\") pod \"09ec087a-1da8-412d-8316-24110d16fd5a\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") "
Sep 10 15:28:27.489792 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.489538    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-istio-data\") pod \"09ec087a-1da8-412d-8316-24110d16fd5a\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") "
Sep 10 15:28:27.489792 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.489572    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct99x\" (UniqueName: \"kubernetes.io/projected/09ec087a-1da8-412d-8316-24110d16fd5a-kube-api-access-ct99x\") pod \"09ec087a-1da8-412d-8316-24110d16fd5a\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") "
Sep 10 15:28:27.489792 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.489587    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-workload-certs\") pod \"09ec087a-1da8-412d-8316-24110d16fd5a\" (UID: \"09ec087a-1da8-412d-8316-24110d16fd5a\") "
Sep 10 15:28:27.489792 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.489598    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "09ec087a-1da8-412d-8316-24110d16fd5a" (UID: "09ec087a-1da8-412d-8316-24110d16fd5a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:28:27.490018 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.489787    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-istio-data" (OuterVolumeSpecName: "istio-data") pod "09ec087a-1da8-412d-8316-24110d16fd5a" (UID: "09ec087a-1da8-412d-8316-24110d16fd5a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:28:27.490018 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.489871    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09ec087a-1da8-412d-8316-24110d16fd5a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "09ec087a-1da8-412d-8316-24110d16fd5a" (UID: "09ec087a-1da8-412d-8316-24110d16fd5a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:28:27.490342 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.490290    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "09ec087a-1da8-412d-8316-24110d16fd5a" (UID: "09ec087a-1da8-412d-8316-24110d16fd5a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:28:27.490342 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.490307    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "09ec087a-1da8-412d-8316-24110d16fd5a" (UID: "09ec087a-1da8-412d-8316-24110d16fd5a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:28:27.490847 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.490578    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ec087a-1da8-412d-8316-24110d16fd5a-istiod-ca-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:28:27.490847 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.490600    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-workload-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:28:27.490847 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.490613    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-istio-data\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:28:27.490847 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.490626    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-workload-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:28:27.490847 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.490639    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-credential-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:28:27.492447 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.492338    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/09ec087a-1da8-412d-8316-24110d16fd5a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "09ec087a-1da8-412d-8316-24110d16fd5a" (UID: "09ec087a-1da8-412d-8316-24110d16fd5a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:28:27.492447 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.492358    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "09ec087a-1da8-412d-8316-24110d16fd5a" (UID: "09ec087a-1da8-412d-8316-24110d16fd5a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:28:27.492447 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.492360    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09ec087a-1da8-412d-8316-24110d16fd5a-istio-token" (OuterVolumeSpecName: "istio-token") pod "09ec087a-1da8-412d-8316-24110d16fd5a" (UID: "09ec087a-1da8-412d-8316-24110d16fd5a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:28:27.492447 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.492407    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09ec087a-1da8-412d-8316-24110d16fd5a-kube-api-access-ct99x" (OuterVolumeSpecName: "kube-api-access-ct99x") pod "09ec087a-1da8-412d-8316-24110d16fd5a" (UID: "09ec087a-1da8-412d-8316-24110d16fd5a"). InnerVolumeSpecName "kube-api-access-ct99x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:28:27.592083 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.591989    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ec087a-1da8-412d-8316-24110d16fd5a-istio-token\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:28:27.592083 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.592013    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ec087a-1da8-412d-8316-24110d16fd5a-istio-podinfo\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:28:27.592083 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.592022    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ec087a-1da8-412d-8316-24110d16fd5a-istio-envoy\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:28:27.592083 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.592030    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct99x\" (UniqueName: \"kubernetes.io/projected/09ec087a-1da8-412d-8316-24110d16fd5a-kube-api-access-ct99x\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:28:27.718624 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.718587    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"]
Sep 10 15:28:27.722147 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:27.722115    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8b74e71b-openshift-default-547fc5c756-fbrn4"]
Sep 10 15:28:28.080148 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:28.080113    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:28:28.080598 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:28.080523    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:28:28.081749 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:28.081715    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:28:29.410724 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:29.410694    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09ec087a-1da8-412d-8316-24110d16fd5a" path="/var/lib/kubelet/pods/09ec087a-1da8-412d-8316-24110d16fd5a/volumes"
Sep 10 15:28:45.500819 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:45.500727    2574 generic.go:356] "Generic (PLEG): container finished" podID="940ca4f5-54c8-4837-9f54-b001e2402ad4" containerID="1f88428fe2bea318b837b678c39a97ff511bed9d2458fe213e026af7150a0d74" exitCode=0
Sep 10 15:28:45.500819 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:45.500799    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm" event={"ID":"940ca4f5-54c8-4837-9f54-b001e2402ad4","Type":"ContainerDied","Data":"1f88428fe2bea318b837b678c39a97ff511bed9d2458fe213e026af7150a0d74"}
Sep 10 15:28:45.501378 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:45.501360    2574 scope.go:117] "RemoveContainer" containerID="1f88428fe2bea318b837b678c39a97ff511bed9d2458fe213e026af7150a0d74"
Sep 10 15:28:45.502600 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:45.502569    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:28:45.502658 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:45.502642    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:28:45.502693 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:45.502676    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:28:46.508615 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:46.508580    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm" event={"ID":"940ca4f5-54c8-4837-9f54-b001e2402ad4","Type":"ContainerStarted","Data":"3d075851b9de04b8b510f3ec804f2e510b58495eb6ce8de2d400d8c441898832"}
Sep 10 15:28:47.293460 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:47.293423    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:47.293654 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:47.293631    2574 patch_prober.go:28] interesting pod/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 15:28:47.293701 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:47.293677    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm" podUID="940ca4f5-54c8-4837-9f54-b001e2402ad4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 15:28:48.293335 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:48.293290    2574 patch_prober.go:28] interesting pod/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 15:28:48.293729 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:48.293360    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm" podUID="940ca4f5-54c8-4837-9f54-b001e2402ad4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 15:28:49.293442 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:49.293402    2574 patch_prober.go:28] interesting pod/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 15:28:49.293807 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:49.293475    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm" podUID="940ca4f5-54c8-4837-9f54-b001e2402ad4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 15:28:50.293304 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:50.293262    2574 patch_prober.go:28] interesting pod/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 15:28:50.293464 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:50.293320    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm" podUID="940ca4f5-54c8-4837-9f54-b001e2402ad4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 15:28:50.828322 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:50.828286    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8d054c9d-d92bf"]
Sep 10 15:28:50.829118 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:50.829090    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09ec087a-1da8-412d-8316-24110d16fd5a" containerName="istio-proxy"
Sep 10 15:28:50.829272 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:50.829258    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="09ec087a-1da8-412d-8316-24110d16fd5a" containerName="istio-proxy"
Sep 10 15:28:50.829529 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:50.829514    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="09ec087a-1da8-412d-8316-24110d16fd5a" containerName="istio-proxy"
Sep 10 15:28:50.829634 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:50.829622    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="09ec087a-1da8-412d-8316-24110d16fd5a" containerName="istio-proxy"
Sep 10 15:28:50.832866 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:50.832845    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8d054c9d-d92bf"
Sep 10 15:28:50.837338 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:50.837315    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 15:28:50.837653 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:50.837353    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zzl2g\""
Sep 10 15:28:50.843826 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:50.843795    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8d054c9d-d92bf"]
Sep 10 15:28:50.934514 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:50.934437    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec7f828-069a-48ca-afdc-6afcb1d10c83-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8d054c9d-d92bf\" (UID: \"6ec7f828-069a-48ca-afdc-6afcb1d10c83\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8d054c9d-d92bf"
Sep 10 15:28:51.035522 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:51.035485    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec7f828-069a-48ca-afdc-6afcb1d10c83-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8d054c9d-d92bf\" (UID: \"6ec7f828-069a-48ca-afdc-6afcb1d10c83\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8d054c9d-d92bf"
Sep 10 15:28:51.036709 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:51.036679    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec7f828-069a-48ca-afdc-6afcb1d10c83-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8d054c9d-d92bf\" (UID: \"6ec7f828-069a-48ca-afdc-6afcb1d10c83\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8d054c9d-d92bf"
Sep 10 15:28:51.153554 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:51.153444    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8d054c9d-d92bf"
Sep 10 15:28:51.293721 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:51.293672    2574 patch_prober.go:28] interesting pod/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 15:28:51.294223 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:51.293737    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm" podUID="940ca4f5-54c8-4837-9f54-b001e2402ad4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 15:28:51.437848 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:51.437819    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8d054c9d-d92bf"]
Sep 10 15:28:51.438279 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:28:51.438245    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec7f828_069a_48ca_afdc_6afcb1d10c83.slice/crio-d0ba274a91523a3a3c709eedd4dabdc929d9c7ffeaba83da322bfa6c2a4e34c1 WatchSource:0}: Error finding container d0ba274a91523a3a3c709eedd4dabdc929d9c7ffeaba83da322bfa6c2a4e34c1: Status 404 returned error can't find the container with id d0ba274a91523a3a3c709eedd4dabdc929d9c7ffeaba83da322bfa6c2a4e34c1
Sep 10 15:28:51.540694 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:51.540603    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8d054c9d-d92bf" event={"ID":"6ec7f828-069a-48ca-afdc-6afcb1d10c83","Type":"ContainerStarted","Data":"d0ba274a91523a3a3c709eedd4dabdc929d9c7ffeaba83da322bfa6c2a4e34c1"}
Sep 10 15:28:52.297160 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:52.297124    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:52.297611 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:52.297511    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:52.298188 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:52.298168    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:28:52.553897 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:52.553861    2574 generic.go:356] "Generic (PLEG): container finished" podID="6ec7f828-069a-48ca-afdc-6afcb1d10c83" containerID="f4e9a1f82ca12b70b5dac84f9d12e537e37e85b5e4476564aa21070a5fec0afb" exitCode=0
Sep 10 15:28:52.554091 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:52.553965    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8d054c9d-d92bf" event={"ID":"6ec7f828-069a-48ca-afdc-6afcb1d10c83","Type":"ContainerDied","Data":"f4e9a1f82ca12b70b5dac84f9d12e537e37e85b5e4476564aa21070a5fec0afb"}
Sep 10 15:28:53.689677 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:53.689653    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8d054c9d-d92bf"
Sep 10 15:28:53.764209 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:53.764176    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec7f828-069a-48ca-afdc-6afcb1d10c83-maas-api-service-ca\") pod \"6ec7f828-069a-48ca-afdc-6afcb1d10c83\" (UID: \"6ec7f828-069a-48ca-afdc-6afcb1d10c83\") "
Sep 10 15:28:53.764553 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:53.764531    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ec7f828-069a-48ca-afdc-6afcb1d10c83-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6ec7f828-069a-48ca-afdc-6afcb1d10c83" (UID: "6ec7f828-069a-48ca-afdc-6afcb1d10c83"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:28:53.865749 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:53.865650    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec7f828-069a-48ca-afdc-6afcb1d10c83-maas-api-service-ca\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:28:54.566573 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:54.566546    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8d054c9d-d92bf"
Sep 10 15:28:54.566573 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:54.566556    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8d054c9d-d92bf" event={"ID":"6ec7f828-069a-48ca-afdc-6afcb1d10c83","Type":"ContainerDied","Data":"d0ba274a91523a3a3c709eedd4dabdc929d9c7ffeaba83da322bfa6c2a4e34c1"}
Sep 10 15:28:54.566798 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:54.566598    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0ba274a91523a3a3c709eedd4dabdc929d9c7ffeaba83da322bfa6c2a4e34c1"
Sep 10 15:28:58.048283 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:58.048247    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8d054c9d-d92bf"]
Sep 10 15:28:58.052212 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:58.052175    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8d054c9d-d92bf"]
Sep 10 15:28:58.188326 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:58.187737    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"]
Sep 10 15:28:58.188326 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:58.188036    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm" podUID="940ca4f5-54c8-4837-9f54-b001e2402ad4" containerName="istio-proxy" containerID="cri-o://3d075851b9de04b8b510f3ec804f2e510b58495eb6ce8de2d400d8c441898832" gracePeriod=30
Sep 10 15:28:58.920475 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:58.920443    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"]
Sep 10 15:28:58.920883 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:58.920870    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ec7f828-069a-48ca-afdc-6afcb1d10c83" containerName="revoke-keys"
Sep 10 15:28:58.920958 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:58.920885    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ec7f828-069a-48ca-afdc-6afcb1d10c83" containerName="revoke-keys"
Sep 10 15:28:58.920958 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:58.920897    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09ec087a-1da8-412d-8316-24110d16fd5a" containerName="istio-proxy"
Sep 10 15:28:58.920958 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:58.920903    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="09ec087a-1da8-412d-8316-24110d16fd5a" containerName="istio-proxy"
Sep 10 15:28:58.921064 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:58.920984    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ec7f828-069a-48ca-afdc-6afcb1d10c83" containerName="revoke-keys"
Sep 10 15:28:58.923509 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:58.923481    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:58.926240 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:58.926218    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9fd15233-openshift-default-dockercfg-qzpv4\""
Sep 10 15:28:58.938841 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:58.938815    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"]
Sep 10 15:28:59.015684 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.015644    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-credential-socket\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.015993 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.015959    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-envoy\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.016120 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.016044    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-workload-socket\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.016120 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.016108    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/053d40ef-c082-49de-83f9-eca47c3fd60e-istiod-ca-cert\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.016264 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.016177    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-data\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.016264 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.016242    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-token\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.016371 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.016286    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2shx\" (UniqueName: \"kubernetes.io/projected/053d40ef-c082-49de-83f9-eca47c3fd60e-kube-api-access-l2shx\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.016371 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.016321    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-workload-certs\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.016371 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.016345    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-podinfo\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.117318 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.117277    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-credential-socket\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.117789 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.117331    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-envoy\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.117789 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.117372    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-workload-socket\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.117789 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.117409    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/053d40ef-c082-49de-83f9-eca47c3fd60e-istiod-ca-cert\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.117789 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.117467    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-data\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.117789 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.117496    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-token\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.117789 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.117641    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2shx\" (UniqueName: \"kubernetes.io/projected/053d40ef-c082-49de-83f9-eca47c3fd60e-kube-api-access-l2shx\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.117789 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.117688    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-workload-certs\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.117789 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.117726    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-podinfo\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.117789 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.117754    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-credential-socket\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.118230 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.117925    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-workload-socket\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.118230 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.118000    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-data\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.118230 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.118119    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-workload-certs\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.118230 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.118204    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/053d40ef-c082-49de-83f9-eca47c3fd60e-istiod-ca-cert\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.119740 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.119717    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-envoy\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.120094 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.120077    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-podinfo\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.125610 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.125581    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-token\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.125742 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.125724    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2shx\" (UniqueName: \"kubernetes.io/projected/053d40ef-c082-49de-83f9-eca47c3fd60e-kube-api-access-l2shx\") pod \"e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") " pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.233769 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.233672    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:28:59.409869 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.409823    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ec7f828-069a-48ca-afdc-6afcb1d10c83" path="/var/lib/kubelet/pods/6ec7f828-069a-48ca-afdc-6afcb1d10c83/volumes"
Sep 10 15:28:59.508772 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.508742    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"]
Sep 10 15:28:59.511791 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:28:59.511765    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod053d40ef_c082_49de_83f9_eca47c3fd60e.slice/crio-9fca280ae0b64cf4c981a38f0bf49449737752b0d3260327ffa1643076344211 WatchSource:0}: Error finding container 9fca280ae0b64cf4c981a38f0bf49449737752b0d3260327ffa1643076344211: Status 404 returned error can't find the container with id 9fca280ae0b64cf4c981a38f0bf49449737752b0d3260327ffa1643076344211
Sep 10 15:28:59.514238 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.514205    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:28:59.514324 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.514275    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:28:59.514324 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.514306    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:28:59.599011 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.598963    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6" event={"ID":"053d40ef-c082-49de-83f9-eca47c3fd60e","Type":"ContainerStarted","Data":"24492f906973b697383124926adaa4175e798a770d623db2eb8b0914851dc88e"}
Sep 10 15:28:59.599221 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.599040    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6" event={"ID":"053d40ef-c082-49de-83f9-eca47c3fd60e","Type":"ContainerStarted","Data":"9fca280ae0b64cf4c981a38f0bf49449737752b0d3260327ffa1643076344211"}
Sep 10 15:28:59.625496 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:28:59.625433    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6" podStartSLOduration=1.625416363 podStartE2EDuration="1.625416363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:28:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:28:59.622642044 +0000 UTC m=+792.672440554" watchObservedRunningTime="2026-09-10 15:28:59.625416363 +0000 UTC m=+792.675214872"
Sep 10 15:29:00.234101 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:00.234063    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:29:00.239176 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:00.239150    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:29:00.605170 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:00.605143    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:29:00.606067 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:00.606045    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:29:03.452321 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.452293    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:29:03.562989 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.562957    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-data\") pod \"940ca4f5-54c8-4837-9f54-b001e2402ad4\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") "
Sep 10 15:29:03.563178 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.563022    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-token\") pod \"940ca4f5-54c8-4837-9f54-b001e2402ad4\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") "
Sep 10 15:29:03.563178 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.563046    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-credential-socket\") pod \"940ca4f5-54c8-4837-9f54-b001e2402ad4\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") "
Sep 10 15:29:03.563178 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.563075    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-workload-certs\") pod \"940ca4f5-54c8-4837-9f54-b001e2402ad4\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") "
Sep 10 15:29:03.563178 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.563094    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-envoy\") pod \"940ca4f5-54c8-4837-9f54-b001e2402ad4\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") "
Sep 10 15:29:03.563178 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.563126    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-workload-socket\") pod \"940ca4f5-54c8-4837-9f54-b001e2402ad4\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") "
Sep 10 15:29:03.563441 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.563198    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtnd7\" (UniqueName: \"kubernetes.io/projected/940ca4f5-54c8-4837-9f54-b001e2402ad4-kube-api-access-rtnd7\") pod \"940ca4f5-54c8-4837-9f54-b001e2402ad4\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") "
Sep 10 15:29:03.563441 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.563222    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/940ca4f5-54c8-4837-9f54-b001e2402ad4-istiod-ca-cert\") pod \"940ca4f5-54c8-4837-9f54-b001e2402ad4\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") "
Sep 10 15:29:03.563441 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.563256    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-podinfo\") pod \"940ca4f5-54c8-4837-9f54-b001e2402ad4\" (UID: \"940ca4f5-54c8-4837-9f54-b001e2402ad4\") "
Sep 10 15:29:03.563441 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.563291    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-data" (OuterVolumeSpecName: "istio-data") pod "940ca4f5-54c8-4837-9f54-b001e2402ad4" (UID: "940ca4f5-54c8-4837-9f54-b001e2402ad4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:29:03.563441 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.563361    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "940ca4f5-54c8-4837-9f54-b001e2402ad4" (UID: "940ca4f5-54c8-4837-9f54-b001e2402ad4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:29:03.563695 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.563616    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/940ca4f5-54c8-4837-9f54-b001e2402ad4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "940ca4f5-54c8-4837-9f54-b001e2402ad4" (UID: "940ca4f5-54c8-4837-9f54-b001e2402ad4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:29:03.563695 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.563465    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "940ca4f5-54c8-4837-9f54-b001e2402ad4" (UID: "940ca4f5-54c8-4837-9f54-b001e2402ad4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:29:03.563695 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.563682    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/940ca4f5-54c8-4837-9f54-b001e2402ad4-istiod-ca-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:29:03.563848 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.563693    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "940ca4f5-54c8-4837-9f54-b001e2402ad4" (UID: "940ca4f5-54c8-4837-9f54-b001e2402ad4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:29:03.563848 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.563701    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-data\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:29:03.563848 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.563726    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-credential-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:29:03.565794 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.565766    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "940ca4f5-54c8-4837-9f54-b001e2402ad4" (UID: "940ca4f5-54c8-4837-9f54-b001e2402ad4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:29:03.565919 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.565832    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "940ca4f5-54c8-4837-9f54-b001e2402ad4" (UID: "940ca4f5-54c8-4837-9f54-b001e2402ad4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:29:03.566021 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.565953    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-token" (OuterVolumeSpecName: "istio-token") pod "940ca4f5-54c8-4837-9f54-b001e2402ad4" (UID: "940ca4f5-54c8-4837-9f54-b001e2402ad4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:29:03.566463 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.566441    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/940ca4f5-54c8-4837-9f54-b001e2402ad4-kube-api-access-rtnd7" (OuterVolumeSpecName: "kube-api-access-rtnd7") pod "940ca4f5-54c8-4837-9f54-b001e2402ad4" (UID: "940ca4f5-54c8-4837-9f54-b001e2402ad4"). InnerVolumeSpecName "kube-api-access-rtnd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:29:03.624920 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.624880    2574 generic.go:356] "Generic (PLEG): container finished" podID="940ca4f5-54c8-4837-9f54-b001e2402ad4" containerID="3d075851b9de04b8b510f3ec804f2e510b58495eb6ce8de2d400d8c441898832" exitCode=0
Sep 10 15:29:03.625117 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.624922    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm" event={"ID":"940ca4f5-54c8-4837-9f54-b001e2402ad4","Type":"ContainerDied","Data":"3d075851b9de04b8b510f3ec804f2e510b58495eb6ce8de2d400d8c441898832"}
Sep 10 15:29:03.625117 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.624924    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"
Sep 10 15:29:03.625117 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.624995    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm" event={"ID":"940ca4f5-54c8-4837-9f54-b001e2402ad4","Type":"ContainerDied","Data":"04907303b08f830c1c889a58cfed2e3bd0976834b54c3d931320e7653d78defe"}
Sep 10 15:29:03.625117 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.625020    2574 scope.go:117] "RemoveContainer" containerID="3d075851b9de04b8b510f3ec804f2e510b58495eb6ce8de2d400d8c441898832"
Sep 10 15:29:03.635780 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.635764    2574 scope.go:117] "RemoveContainer" containerID="1f88428fe2bea318b837b678c39a97ff511bed9d2458fe213e026af7150a0d74"
Sep 10 15:29:03.644191 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.644173    2574 scope.go:117] "RemoveContainer" containerID="3d075851b9de04b8b510f3ec804f2e510b58495eb6ce8de2d400d8c441898832"
Sep 10 15:29:03.644438 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:29:03.644420    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d075851b9de04b8b510f3ec804f2e510b58495eb6ce8de2d400d8c441898832\": container with ID starting with 3d075851b9de04b8b510f3ec804f2e510b58495eb6ce8de2d400d8c441898832 not found: ID does not exist" containerID="3d075851b9de04b8b510f3ec804f2e510b58495eb6ce8de2d400d8c441898832"
Sep 10 15:29:03.644484 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.644446    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d075851b9de04b8b510f3ec804f2e510b58495eb6ce8de2d400d8c441898832"} err="failed to get container status \"3d075851b9de04b8b510f3ec804f2e510b58495eb6ce8de2d400d8c441898832\": rpc error: code = NotFound desc = could not find container \"3d075851b9de04b8b510f3ec804f2e510b58495eb6ce8de2d400d8c441898832\": container with ID starting with 3d075851b9de04b8b510f3ec804f2e510b58495eb6ce8de2d400d8c441898832 not found: ID does not exist"
Sep 10 15:29:03.644484 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.644463    2574 scope.go:117] "RemoveContainer" containerID="1f88428fe2bea318b837b678c39a97ff511bed9d2458fe213e026af7150a0d74"
Sep 10 15:29:03.644666 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:29:03.644651    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f88428fe2bea318b837b678c39a97ff511bed9d2458fe213e026af7150a0d74\": container with ID starting with 1f88428fe2bea318b837b678c39a97ff511bed9d2458fe213e026af7150a0d74 not found: ID does not exist" containerID="1f88428fe2bea318b837b678c39a97ff511bed9d2458fe213e026af7150a0d74"
Sep 10 15:29:03.644706 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.644670    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f88428fe2bea318b837b678c39a97ff511bed9d2458fe213e026af7150a0d74"} err="failed to get container status \"1f88428fe2bea318b837b678c39a97ff511bed9d2458fe213e026af7150a0d74\": rpc error: code = NotFound desc = could not find container \"1f88428fe2bea318b837b678c39a97ff511bed9d2458fe213e026af7150a0d74\": container with ID starting with 1f88428fe2bea318b837b678c39a97ff511bed9d2458fe213e026af7150a0d74 not found: ID does not exist"
Sep 10 15:29:03.651687 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.651666    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"]
Sep 10 15:29:03.659924 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.659901    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-8d054c9d-gw-openshift-default-5f6488d6c6-shtpm"]
Sep 10 15:29:03.664788 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.664773    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-token\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:29:03.664849 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.664791    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-workload-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:29:03.664849 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.664800    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-envoy\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:29:03.664849 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.664808    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/940ca4f5-54c8-4837-9f54-b001e2402ad4-workload-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:29:03.664849 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.664817    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtnd7\" (UniqueName: \"kubernetes.io/projected/940ca4f5-54c8-4837-9f54-b001e2402ad4-kube-api-access-rtnd7\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:29:03.664849 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:03.664828    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/940ca4f5-54c8-4837-9f54-b001e2402ad4-istio-podinfo\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:29:05.409921 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:05.409890    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="940ca4f5-54c8-4837-9f54-b001e2402ad4" path="/var/lib/kubelet/pods/940ca4f5-54c8-4837-9f54-b001e2402ad4/volumes"
Sep 10 15:29:16.647129 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:16.647086    2574 patch_prober.go:28] interesting pod/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 15:29:16.647571 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:16.647152    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6" podUID="053d40ef-c082-49de-83f9-eca47c3fd60e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 15:29:17.720627 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:17.720526    2574 generic.go:356] "Generic (PLEG): container finished" podID="053d40ef-c082-49de-83f9-eca47c3fd60e" containerID="24492f906973b697383124926adaa4175e798a770d623db2eb8b0914851dc88e" exitCode=0
Sep 10 15:29:17.721021 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:17.720610    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6" event={"ID":"053d40ef-c082-49de-83f9-eca47c3fd60e","Type":"ContainerDied","Data":"24492f906973b697383124926adaa4175e798a770d623db2eb8b0914851dc88e"}
Sep 10 15:29:17.721157 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:17.721137    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2e2b69-mt77r"]
Sep 10 15:29:17.721196 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:17.721158    2574 scope.go:117] "RemoveContainer" containerID="24492f906973b697383124926adaa4175e798a770d623db2eb8b0914851dc88e"
Sep 10 15:29:17.721676 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:17.721657    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="940ca4f5-54c8-4837-9f54-b001e2402ad4" containerName="istio-proxy"
Sep 10 15:29:17.721676 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:17.721677    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="940ca4f5-54c8-4837-9f54-b001e2402ad4" containerName="istio-proxy"
Sep 10 15:29:17.721821 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:17.721686    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="940ca4f5-54c8-4837-9f54-b001e2402ad4" containerName="istio-proxy"
Sep 10 15:29:17.721821 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:17.721692    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="940ca4f5-54c8-4837-9f54-b001e2402ad4" containerName="istio-proxy"
Sep 10 15:29:17.721821 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:17.721761    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="940ca4f5-54c8-4837-9f54-b001e2402ad4" containerName="istio-proxy"
Sep 10 15:29:17.721821 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:17.721768    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="940ca4f5-54c8-4837-9f54-b001e2402ad4" containerName="istio-proxy"
Sep 10 15:29:17.722438 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:17.722412    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:29:17.722496 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:17.722482    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:29:17.722530 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:17.722518    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:29:17.724831 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:17.724813    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2e2b69-mt77r"
Sep 10 15:29:17.727562 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:17.727545    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zzl2g\""
Sep 10 15:29:17.727662 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:17.727546    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 15:29:17.734224 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:17.734199    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2e2b69-mt77r"]
Sep 10 15:29:17.811109 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:17.811073    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-2e2b69-mt77r\" (UID: \"4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2e2b69-mt77r"
Sep 10 15:29:17.912673 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:17.912630    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-2e2b69-mt77r\" (UID: \"4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2e2b69-mt77r"
Sep 10 15:29:17.913297 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:17.913273    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-2e2b69-mt77r\" (UID: \"4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2e2b69-mt77r"
Sep 10 15:29:18.037190 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:18.037101    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2e2b69-mt77r"
Sep 10 15:29:18.328759 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:29:18.328731    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bacb2f8_6f8c_47a6_b5dd_d240fdf3e517.slice/crio-acaab3e169c3d004fc85748d8335b48a327b0fe3eb9581308bb85c5c8b84de65 WatchSource:0}: Error finding container acaab3e169c3d004fc85748d8335b48a327b0fe3eb9581308bb85c5c8b84de65: Status 404 returned error can't find the container with id acaab3e169c3d004fc85748d8335b48a327b0fe3eb9581308bb85c5c8b84de65
Sep 10 15:29:18.329589 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:18.329560    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2e2b69-mt77r"]
Sep 10 15:29:18.728360 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:18.728316    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6" event={"ID":"053d40ef-c082-49de-83f9-eca47c3fd60e","Type":"ContainerStarted","Data":"d8e7fd5e5195b1f7240888203efaae5a52d8226d6794ec268f900b1a2f7906eb"}
Sep 10 15:29:18.732422 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:18.732386    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2e2b69-mt77r" event={"ID":"4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517","Type":"ContainerStarted","Data":"b347ffba66474284f695bc17040449999dde75bffb437d3323621e3a5f636555"}
Sep 10 15:29:18.732552 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:18.732448    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2e2b69-mt77r" event={"ID":"4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517","Type":"ContainerStarted","Data":"acaab3e169c3d004fc85748d8335b48a327b0fe3eb9581308bb85c5c8b84de65"}
Sep 10 15:29:18.774657 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:18.774578    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2e2b69-mt77r" podStartSLOduration=1.774555418 podStartE2EDuration="1.774555418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:29:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:29:18.773704722 +0000 UTC m=+811.823503232" watchObservedRunningTime="2026-09-10 15:29:18.774555418 +0000 UTC m=+811.824353927"
Sep 10 15:29:19.235064 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:19.234611    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:29:19.235064 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:19.234747    2574 patch_prober.go:28] interesting pod/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 10 15:29:19.235064 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:19.234793    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6" podUID="053d40ef-c082-49de-83f9-eca47c3fd60e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 10 15:29:19.745642 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:19.744489    2574 generic.go:356] "Generic (PLEG): container finished" podID="4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517" containerID="b347ffba66474284f695bc17040449999dde75bffb437d3323621e3a5f636555" exitCode=0
Sep 10 15:29:19.745642 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:19.745566    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2e2b69-mt77r" event={"ID":"4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517","Type":"ContainerDied","Data":"b347ffba66474284f695bc17040449999dde75bffb437d3323621e3a5f636555"}
Sep 10 15:29:20.234745 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:20.234695    2574 patch_prober.go:28] interesting pod/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 10 15:29:20.234982 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:20.234776    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6" podUID="053d40ef-c082-49de-83f9-eca47c3fd60e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 10 15:29:20.913204 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:20.913175    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2e2b69-mt77r"
Sep 10 15:29:20.960195 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:20.960164    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517-maas-api-service-ca\") pod \"4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517\" (UID: \"4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517\") "
Sep 10 15:29:20.960503 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:20.960479    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517" (UID: "4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:29:21.061492 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:21.061454    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517-maas-api-service-ca\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:29:21.235056 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:21.235017    2574 patch_prober.go:28] interesting pod/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 10 15:29:21.235368 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:21.235329    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6" podUID="053d40ef-c082-49de-83f9-eca47c3fd60e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 10 15:29:21.769145 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:21.769057    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2e2b69-mt77r"
Sep 10 15:29:21.769145 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:21.769091    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2e2b69-mt77r" event={"ID":"4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517","Type":"ContainerDied","Data":"acaab3e169c3d004fc85748d8335b48a327b0fe3eb9581308bb85c5c8b84de65"}
Sep 10 15:29:21.769145 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:21.769138    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="acaab3e169c3d004fc85748d8335b48a327b0fe3eb9581308bb85c5c8b84de65"
Sep 10 15:29:22.234877 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:22.234838    2574 patch_prober.go:28] interesting pod/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 10 15:29:22.235510 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:22.235478    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6" podUID="053d40ef-c082-49de-83f9-eca47c3fd60e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 10 15:29:23.234397 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:23.234350    2574 patch_prober.go:28] interesting pod/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 10 15:29:23.234618 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:23.234423    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6" podUID="053d40ef-c082-49de-83f9-eca47c3fd60e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 10 15:29:24.240818 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:24.240784    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:29:24.241394 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:24.241366    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:29:24.243031 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:24.243000    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:29:26.637623 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:26.637580    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9fd15233-hcjsb"]
Sep 10 15:29:26.638203 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:26.638182    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517" containerName="revoke-keys"
Sep 10 15:29:26.638291 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:26.638206    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517" containerName="revoke-keys"
Sep 10 15:29:26.638373 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:26.638360    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517" containerName="revoke-keys"
Sep 10 15:29:26.641693 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:26.641671    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9fd15233-hcjsb"
Sep 10 15:29:26.644627 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:26.644608    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 15:29:26.644734 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:26.644606    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zzl2g\""
Sep 10 15:29:26.651309 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:26.651279    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9fd15233-hcjsb"]
Sep 10 15:29:26.719803 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:26.719768    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9fd15233-hcjsb\" (UID: \"3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9fd15233-hcjsb"
Sep 10 15:29:26.820442 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:26.820412    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9fd15233-hcjsb\" (UID: \"3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9fd15233-hcjsb"
Sep 10 15:29:26.821088 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:26.821065    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9fd15233-hcjsb\" (UID: \"3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9fd15233-hcjsb"
Sep 10 15:29:26.955923 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:26.955834    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9fd15233-hcjsb"
Sep 10 15:29:27.231783 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:27.231594    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9fd15233-hcjsb"]
Sep 10 15:29:27.232745 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:29:27.232712    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cdcf53c_b9b8_49b1_a2b1_e7efa990e11c.slice/crio-c2c28bf0037cc18ff5066daa4552a79b55f6490a90f644fd20e2155498551a4b WatchSource:0}: Error finding container c2c28bf0037cc18ff5066daa4552a79b55f6490a90f644fd20e2155498551a4b: Status 404 returned error can't find the container with id c2c28bf0037cc18ff5066daa4552a79b55f6490a90f644fd20e2155498551a4b
Sep 10 15:29:27.804120 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:27.804084    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9fd15233-hcjsb" event={"ID":"3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c","Type":"ContainerStarted","Data":"a68bb845ba34e04a6d53fbe36cd7d5187023aa2a6d04f96112abd633080b2802"}
Sep 10 15:29:27.804660 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:27.804140    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9fd15233-hcjsb" event={"ID":"3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c","Type":"ContainerStarted","Data":"c2c28bf0037cc18ff5066daa4552a79b55f6490a90f644fd20e2155498551a4b"}
Sep 10 15:29:27.825151 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:27.825097    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9fd15233-hcjsb" podStartSLOduration=1.8250800950000001 podStartE2EDuration="1.825080095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:29:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:29:27.823270408 +0000 UTC m=+820.873068918" watchObservedRunningTime="2026-09-10 15:29:27.825080095 +0000 UTC m=+820.874878604"
Sep 10 15:29:28.812432 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:28.812387    2574 generic.go:356] "Generic (PLEG): container finished" podID="3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c" containerID="a68bb845ba34e04a6d53fbe36cd7d5187023aa2a6d04f96112abd633080b2802" exitCode=0
Sep 10 15:29:28.812900 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:28.812432    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9fd15233-hcjsb" event={"ID":"3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c","Type":"ContainerDied","Data":"a68bb845ba34e04a6d53fbe36cd7d5187023aa2a6d04f96112abd633080b2802"}
Sep 10 15:29:28.945030 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:28.944993    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2e2b69-mt77r"]
Sep 10 15:29:28.947550 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:28.947529    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2e2b69-mt77r"]
Sep 10 15:29:29.409469 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:29.409435    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517" path="/var/lib/kubelet/pods/4bacb2f8-6f8c-47a6-b5dd-d240fdf3e517/volumes"
Sep 10 15:29:29.960730 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:29.960704    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9fd15233-hcjsb"
Sep 10 15:29:30.056687 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:30.056650    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c-maas-api-service-ca\") pod \"3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c\" (UID: \"3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c\") "
Sep 10 15:29:30.057026 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:30.057002    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c" (UID: "3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:29:30.158526 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:30.158432    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c-maas-api-service-ca\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:29:30.825406 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:30.825377    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9fd15233-hcjsb"
Sep 10 15:29:30.825406 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:30.825385    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9fd15233-hcjsb" event={"ID":"3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c","Type":"ContainerDied","Data":"c2c28bf0037cc18ff5066daa4552a79b55f6490a90f644fd20e2155498551a4b"}
Sep 10 15:29:30.825614 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:30.825430    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2c28bf0037cc18ff5066daa4552a79b55f6490a90f644fd20e2155498551a4b"
Sep 10 15:29:33.177416 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:33.177379    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9fd15233-hcjsb"]
Sep 10 15:29:33.182155 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:33.182126    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9fd15233-hcjsb"]
Sep 10 15:29:33.409854 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:33.409817    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c" path="/var/lib/kubelet/pods/3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c/volumes"
Sep 10 15:29:34.290949 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:34.290885    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"]
Sep 10 15:29:34.291404 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:34.291178    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6" podUID="053d40ef-c082-49de-83f9-eca47c3fd60e" containerName="istio-proxy" containerID="cri-o://d8e7fd5e5195b1f7240888203efaae5a52d8226d6794ec268f900b1a2f7906eb" gracePeriod=30
Sep 10 15:29:34.987955 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:34.987906    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"]
Sep 10 15:29:34.988413 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:34.988397    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c" containerName="revoke-keys"
Sep 10 15:29:34.988478 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:34.988415    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c" containerName="revoke-keys"
Sep 10 15:29:34.988524 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:34.988499    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cdcf53c-b9b8-49b1-a2b1-e7efa990e11c" containerName="revoke-keys"
Sep 10 15:29:34.992059 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:34.992040    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:34.995110 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:34.995087    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f5d25c39-openshift-default-dockercfg-jqq62\""
Sep 10 15:29:35.003676 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.003649    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"]
Sep 10 15:29:35.110050 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.109997    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8cvz\" (UniqueName: \"kubernetes.io/projected/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-kube-api-access-k8cvz\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.110387 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.110361    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istiod-ca-cert\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.110587 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.110571    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-token\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.110706 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.110693    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-workload-certs\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.110803 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.110789    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-data\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.110895 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.110883    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-envoy\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.111039 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.111024    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-podinfo\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.111172 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.111157    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-credential-socket\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.111299 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.111271    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-workload-socket\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.212620 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.212581    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istiod-ca-cert\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.212834 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.212649    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-token\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.212834 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.212666    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-workload-certs\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.212834 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.212682    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-data\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.212834 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.212700    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-envoy\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.212834 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.212726    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-podinfo\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.212834 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.212749    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-credential-socket\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.213196 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.212843    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-workload-socket\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.213196 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.212915    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8cvz\" (UniqueName: \"kubernetes.io/projected/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-kube-api-access-k8cvz\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.213305 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.213253    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-data\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.213305 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.213283    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-workload-certs\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.213421 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.213399    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-workload-socket\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.213540 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.213517    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-credential-socket\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.213611 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.213519    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istiod-ca-cert\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.215277 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.215255    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-envoy\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.215386 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.215325    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-podinfo\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.221240 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.221214    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-token\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.221397 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.221380    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8cvz\" (UniqueName: \"kubernetes.io/projected/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-kube-api-access-k8cvz\") pod \"e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") " pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.303435 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.303365    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:35.591553 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.591527    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"]
Sep 10 15:29:35.593751 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:29:35.593715    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c255ef6_8ddc_4cbe_aac7_b62deb1526c8.slice/crio-08ece520090bda0d07b53b0cf8af6720777ce57ee39c33ea8100d454e5526696 WatchSource:0}: Error finding container 08ece520090bda0d07b53b0cf8af6720777ce57ee39c33ea8100d454e5526696: Status 404 returned error can't find the container with id 08ece520090bda0d07b53b0cf8af6720777ce57ee39c33ea8100d454e5526696
Sep 10 15:29:35.596105 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.596074    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:29:35.596174 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.596138    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:29:35.596214 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.596172    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:29:35.860272 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.860174    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4" event={"ID":"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8","Type":"ContainerStarted","Data":"27fd646a7fd030ffe855e91a511c19674ed4988e43ea0dd8252161454273b2b2"}
Sep 10 15:29:35.860272 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.860234    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4" event={"ID":"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8","Type":"ContainerStarted","Data":"08ece520090bda0d07b53b0cf8af6720777ce57ee39c33ea8100d454e5526696"}
Sep 10 15:29:35.889644 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:35.889585    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4" podStartSLOduration=1.889562285 podStartE2EDuration="1.889562285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:29:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:29:35.885386699 +0000 UTC m=+828.935185208" watchObservedRunningTime="2026-09-10 15:29:35.889562285 +0000 UTC m=+828.939360795"
Sep 10 15:29:36.304085 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:36.304048    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:36.305562 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:36.305538    2574 patch_prober.go:28] interesting pod/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 10 15:29:36.305663 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:36.305596    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4" podUID="7c255ef6-8ddc-4cbe-aac7-b62deb1526c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 10 15:29:37.307629 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:37.307597    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:37.871765 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:37.871736    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:37.872655 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:37.872632    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:29:39.244521 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.244481    2574 patch_prober.go:28] interesting pod/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 15:29:39.244903 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.244557    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6" podUID="053d40ef-c082-49de-83f9-eca47c3fd60e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 15:29:39.552986 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.552962    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:29:39.662542 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.662509    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-workload-certs\") pod \"053d40ef-c082-49de-83f9-eca47c3fd60e\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") "
Sep 10 15:29:39.662711 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.662557    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-data\") pod \"053d40ef-c082-49de-83f9-eca47c3fd60e\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") "
Sep 10 15:29:39.662711 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.662577    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-token\") pod \"053d40ef-c082-49de-83f9-eca47c3fd60e\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") "
Sep 10 15:29:39.662711 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.662594    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2shx\" (UniqueName: \"kubernetes.io/projected/053d40ef-c082-49de-83f9-eca47c3fd60e-kube-api-access-l2shx\") pod \"053d40ef-c082-49de-83f9-eca47c3fd60e\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") "
Sep 10 15:29:39.662711 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.662655    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-workload-socket\") pod \"053d40ef-c082-49de-83f9-eca47c3fd60e\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") "
Sep 10 15:29:39.662711 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.662677    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-envoy\") pod \"053d40ef-c082-49de-83f9-eca47c3fd60e\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") "
Sep 10 15:29:39.663039 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.662719    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-credential-socket\") pod \"053d40ef-c082-49de-83f9-eca47c3fd60e\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") "
Sep 10 15:29:39.663039 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.662743    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-podinfo\") pod \"053d40ef-c082-49de-83f9-eca47c3fd60e\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") "
Sep 10 15:29:39.663039 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.662769    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/053d40ef-c082-49de-83f9-eca47c3fd60e-istiod-ca-cert\") pod \"053d40ef-c082-49de-83f9-eca47c3fd60e\" (UID: \"053d40ef-c082-49de-83f9-eca47c3fd60e\") "
Sep 10 15:29:39.663039 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.662811    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "053d40ef-c082-49de-83f9-eca47c3fd60e" (UID: "053d40ef-c082-49de-83f9-eca47c3fd60e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:29:39.663039 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.662834    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-data" (OuterVolumeSpecName: "istio-data") pod "053d40ef-c082-49de-83f9-eca47c3fd60e" (UID: "053d40ef-c082-49de-83f9-eca47c3fd60e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:29:39.663310 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.663041    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "053d40ef-c082-49de-83f9-eca47c3fd60e" (UID: "053d40ef-c082-49de-83f9-eca47c3fd60e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:29:39.663310 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.663175    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "053d40ef-c082-49de-83f9-eca47c3fd60e" (UID: "053d40ef-c082-49de-83f9-eca47c3fd60e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:29:39.663310 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.663253    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/053d40ef-c082-49de-83f9-eca47c3fd60e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "053d40ef-c082-49de-83f9-eca47c3fd60e" (UID: "053d40ef-c082-49de-83f9-eca47c3fd60e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:29:39.663310 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.663285    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-workload-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:29:39.663310 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.663305    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-data\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:29:39.663567 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.663319    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-workload-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:29:39.663567 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.663331    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-credential-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:29:39.664910 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.664874    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "053d40ef-c082-49de-83f9-eca47c3fd60e" (UID: "053d40ef-c082-49de-83f9-eca47c3fd60e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:29:39.665117 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.664986    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-token" (OuterVolumeSpecName: "istio-token") pod "053d40ef-c082-49de-83f9-eca47c3fd60e" (UID: "053d40ef-c082-49de-83f9-eca47c3fd60e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:29:39.665117 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.665006    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/053d40ef-c082-49de-83f9-eca47c3fd60e-kube-api-access-l2shx" (OuterVolumeSpecName: "kube-api-access-l2shx") pod "053d40ef-c082-49de-83f9-eca47c3fd60e" (UID: "053d40ef-c082-49de-83f9-eca47c3fd60e"). InnerVolumeSpecName "kube-api-access-l2shx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:29:39.665117 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.665020    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "053d40ef-c082-49de-83f9-eca47c3fd60e" (UID: "053d40ef-c082-49de-83f9-eca47c3fd60e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:29:39.764673 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.764645    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-envoy\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:29:39.764673 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.764671    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-podinfo\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:29:39.764673 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.764679    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/053d40ef-c082-49de-83f9-eca47c3fd60e-istiod-ca-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:29:39.764907 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.764688    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/053d40ef-c082-49de-83f9-eca47c3fd60e-istio-token\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:29:39.764907 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.764698    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2shx\" (UniqueName: \"kubernetes.io/projected/053d40ef-c082-49de-83f9-eca47c3fd60e-kube-api-access-l2shx\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:29:39.885845 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.885809    2574 generic.go:356] "Generic (PLEG): container finished" podID="053d40ef-c082-49de-83f9-eca47c3fd60e" containerID="d8e7fd5e5195b1f7240888203efaae5a52d8226d6794ec268f900b1a2f7906eb" exitCode=0
Sep 10 15:29:39.886042 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.885862    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"
Sep 10 15:29:39.886042 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.885896    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6" event={"ID":"053d40ef-c082-49de-83f9-eca47c3fd60e","Type":"ContainerDied","Data":"d8e7fd5e5195b1f7240888203efaae5a52d8226d6794ec268f900b1a2f7906eb"}
Sep 10 15:29:39.886042 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.885960    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6" event={"ID":"053d40ef-c082-49de-83f9-eca47c3fd60e","Type":"ContainerDied","Data":"9fca280ae0b64cf4c981a38f0bf49449737752b0d3260327ffa1643076344211"}
Sep 10 15:29:39.886042 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.885982    2574 scope.go:117] "RemoveContainer" containerID="d8e7fd5e5195b1f7240888203efaae5a52d8226d6794ec268f900b1a2f7906eb"
Sep 10 15:29:39.897248 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.897070    2574 scope.go:117] "RemoveContainer" containerID="24492f906973b697383124926adaa4175e798a770d623db2eb8b0914851dc88e"
Sep 10 15:29:39.905585 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.905568    2574 scope.go:117] "RemoveContainer" containerID="d8e7fd5e5195b1f7240888203efaae5a52d8226d6794ec268f900b1a2f7906eb"
Sep 10 15:29:39.905818 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:29:39.905797    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8e7fd5e5195b1f7240888203efaae5a52d8226d6794ec268f900b1a2f7906eb\": container with ID starting with d8e7fd5e5195b1f7240888203efaae5a52d8226d6794ec268f900b1a2f7906eb not found: ID does not exist" containerID="d8e7fd5e5195b1f7240888203efaae5a52d8226d6794ec268f900b1a2f7906eb"
Sep 10 15:29:39.905854 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.905827    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8e7fd5e5195b1f7240888203efaae5a52d8226d6794ec268f900b1a2f7906eb"} err="failed to get container status \"d8e7fd5e5195b1f7240888203efaae5a52d8226d6794ec268f900b1a2f7906eb\": rpc error: code = NotFound desc = could not find container \"d8e7fd5e5195b1f7240888203efaae5a52d8226d6794ec268f900b1a2f7906eb\": container with ID starting with d8e7fd5e5195b1f7240888203efaae5a52d8226d6794ec268f900b1a2f7906eb not found: ID does not exist"
Sep 10 15:29:39.905854 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.905847    2574 scope.go:117] "RemoveContainer" containerID="24492f906973b697383124926adaa4175e798a770d623db2eb8b0914851dc88e"
Sep 10 15:29:39.906100 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:29:39.906086    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24492f906973b697383124926adaa4175e798a770d623db2eb8b0914851dc88e\": container with ID starting with 24492f906973b697383124926adaa4175e798a770d623db2eb8b0914851dc88e not found: ID does not exist" containerID="24492f906973b697383124926adaa4175e798a770d623db2eb8b0914851dc88e"
Sep 10 15:29:39.906143 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.906103    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24492f906973b697383124926adaa4175e798a770d623db2eb8b0914851dc88e"} err="failed to get container status \"24492f906973b697383124926adaa4175e798a770d623db2eb8b0914851dc88e\": rpc error: code = NotFound desc = could not find container \"24492f906973b697383124926adaa4175e798a770d623db2eb8b0914851dc88e\": container with ID starting with 24492f906973b697383124926adaa4175e798a770d623db2eb8b0914851dc88e not found: ID does not exist"
Sep 10 15:29:39.912274 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.912250    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"]
Sep 10 15:29:39.915695 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:39.915675    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9fd15233-openshift-default-6b4dd9b746-8psw6"]
Sep 10 15:29:41.410128 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:29:41.410095    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="053d40ef-c082-49de-83f9-eca47c3fd60e" path="/var/lib/kubelet/pods/053d40ef-c082-49de-83f9-eca47c3fd60e/volumes"
Sep 10 15:30:00.151087 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:00.151042    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817570-mbhkr"]
Sep 10 15:30:00.151663 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:00.151635    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="053d40ef-c082-49de-83f9-eca47c3fd60e" containerName="istio-proxy"
Sep 10 15:30:00.151741 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:00.151668    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="053d40ef-c082-49de-83f9-eca47c3fd60e" containerName="istio-proxy"
Sep 10 15:30:00.151796 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:00.151784    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="053d40ef-c082-49de-83f9-eca47c3fd60e" containerName="istio-proxy"
Sep 10 15:30:00.157124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:00.157084    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-50fe56-29817570-rzkc9"]
Sep 10 15:30:00.157290 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:00.157240    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817570-mbhkr"
Sep 10 15:30:00.157568 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:00.157549    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="053d40ef-c082-49de-83f9-eca47c3fd60e" containerName="istio-proxy"
Sep 10 15:30:00.157656 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:00.157570    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="053d40ef-c082-49de-83f9-eca47c3fd60e" containerName="istio-proxy"
Sep 10 15:30:00.157711 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:00.157686    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="053d40ef-c082-49de-83f9-eca47c3fd60e" containerName="istio-proxy"
Sep 10 15:30:00.160600 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:00.160578    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-50fe56-29817570-rzkc9"
Sep 10 15:30:00.163267 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:00.163247    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zzl2g\""
Sep 10 15:30:00.168962 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:00.168877    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817570-mbhkr"]
Sep 10 15:30:00.171443 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:00.171365    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817570-mbhkr"
Sep 10 15:30:00.172606 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:00.172585    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-50fe56-29817570-rzkc9"]
Sep 10 15:30:00.177854 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:00.177836    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-50fe56-29817570-rzkc9"
Sep 10 15:30:00.475391 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:00.475299    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-50fe56-29817570-rzkc9"]
Sep 10 15:30:00.477309 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:30:00.477274    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a4c3b3f_e04c_4016_8b39_3a3ece5db0a5.slice/crio-29a6ec1cf564b8d52928e0d0fe74514d88ad660d112d24a4273b695d6c2ef045 WatchSource:0}: Error finding container 29a6ec1cf564b8d52928e0d0fe74514d88ad660d112d24a4273b695d6c2ef045: Status 404 returned error can't find the container with id 29a6ec1cf564b8d52928e0d0fe74514d88ad660d112d24a4273b695d6c2ef045
Sep 10 15:30:00.487576 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:00.484718    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817570-mbhkr"]
Sep 10 15:30:01.008941 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:01.008830    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817570-mbhkr" event={"ID":"e6110a6c-cb82-4b16-a5a5-10191a0796d7","Type":"ContainerStarted","Data":"c23d763e775943a16465927e5bcde2decddc7d3b26ef4afc2a9998870307aaf1"}
Sep 10 15:30:01.008941 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:01.008887    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817570-mbhkr" event={"ID":"e6110a6c-cb82-4b16-a5a5-10191a0796d7","Type":"ContainerStarted","Data":"e3b6e64d4949eaaef4a0be75121f6143f5387ca2bfdacce02491c2a26a716cf3"}
Sep 10 15:30:01.010394 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:01.010367    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-50fe56-29817570-rzkc9" event={"ID":"9a4c3b3f-e04c-4016-8b39-3a3ece5db0a5","Type":"ContainerStarted","Data":"304d4c789a65cd39bfa92b9911b5e66a62fa992d11676232ae821b62195463f1"}
Sep 10 15:30:01.010509 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:01.010411    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-50fe56-29817570-rzkc9" event={"ID":"9a4c3b3f-e04c-4016-8b39-3a3ece5db0a5","Type":"ContainerStarted","Data":"29a6ec1cf564b8d52928e0d0fe74514d88ad660d112d24a4273b695d6c2ef045"}
Sep 10 15:30:01.046684 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:01.046604    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817570-mbhkr" podStartSLOduration=1.046583114 podStartE2EDuration="1.046583114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:30:01.026790645 +0000 UTC m=+854.076589154" watchObservedRunningTime="2026-09-10 15:30:01.046583114 +0000 UTC m=+854.096381626"
Sep 10 15:30:01.046983 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:01.046947    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-50fe56-29817570-rzkc9" podStartSLOduration=1.046918064 podStartE2EDuration="1.046918064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:30:01.042203466 +0000 UTC m=+854.092001975" watchObservedRunningTime="2026-09-10 15:30:01.046918064 +0000 UTC m=+854.096716573"
Sep 10 15:30:02.017390 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:02.017302    2574 generic.go:356] "Generic (PLEG): container finished" podID="e6110a6c-cb82-4b16-a5a5-10191a0796d7" containerID="c23d763e775943a16465927e5bcde2decddc7d3b26ef4afc2a9998870307aaf1" exitCode=0
Sep 10 15:30:02.017390 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:02.017344    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817570-mbhkr" event={"ID":"e6110a6c-cb82-4b16-a5a5-10191a0796d7","Type":"ContainerDied","Data":"c23d763e775943a16465927e5bcde2decddc7d3b26ef4afc2a9998870307aaf1"}
Sep 10 15:30:02.019011 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:02.018984    2574 generic.go:356] "Generic (PLEG): container finished" podID="9a4c3b3f-e04c-4016-8b39-3a3ece5db0a5" containerID="304d4c789a65cd39bfa92b9911b5e66a62fa992d11676232ae821b62195463f1" exitCode=0
Sep 10 15:30:02.019137 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:02.019019    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-50fe56-29817570-rzkc9" event={"ID":"9a4c3b3f-e04c-4016-8b39-3a3ece5db0a5","Type":"ContainerDied","Data":"304d4c789a65cd39bfa92b9911b5e66a62fa992d11676232ae821b62195463f1"}
Sep 10 15:30:02.036348 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:02.036320    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f5d25c39-gv6w7"]
Sep 10 15:30:02.040727 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:02.040702    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f5d25c39-gv6w7"
Sep 10 15:30:02.043960 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:02.043918    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 15:30:02.051392 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:02.050363    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f5d25c39-gv6w7"]
Sep 10 15:30:02.083067 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:02.083035    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6208499f-efbc-4217-b2e6-aa591bc667e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f5d25c39-gv6w7\" (UID: \"6208499f-efbc-4217-b2e6-aa591bc667e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f5d25c39-gv6w7"
Sep 10 15:30:02.184385 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:02.184342    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6208499f-efbc-4217-b2e6-aa591bc667e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f5d25c39-gv6w7\" (UID: \"6208499f-efbc-4217-b2e6-aa591bc667e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f5d25c39-gv6w7"
Sep 10 15:30:02.185028 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:02.185009    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6208499f-efbc-4217-b2e6-aa591bc667e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f5d25c39-gv6w7\" (UID: \"6208499f-efbc-4217-b2e6-aa591bc667e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f5d25c39-gv6w7"
Sep 10 15:30:02.363973 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:02.363908    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f5d25c39-gv6w7"
Sep 10 15:30:02.645950 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:02.638051    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f5d25c39-gv6w7"]
Sep 10 15:30:03.026812 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:03.026780    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f5d25c39-gv6w7" event={"ID":"6208499f-efbc-4217-b2e6-aa591bc667e6","Type":"ContainerStarted","Data":"695aa934eb745d0fc5a3f98d012588d88376756a9cc807ec17cbed20f581a319"}
Sep 10 15:30:03.225007 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:03.224980    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-50fe56-29817570-rzkc9"
Sep 10 15:30:03.227794 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:03.227777    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817570-mbhkr"
Sep 10 15:30:04.038009 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:04.037887    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817570-mbhkr" event={"ID":"e6110a6c-cb82-4b16-a5a5-10191a0796d7","Type":"ContainerDied","Data":"e3b6e64d4949eaaef4a0be75121f6143f5387ca2bfdacce02491c2a26a716cf3"}
Sep 10 15:30:04.038009 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:04.037971    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3b6e64d4949eaaef4a0be75121f6143f5387ca2bfdacce02491c2a26a716cf3"
Sep 10 15:30:04.038547 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:04.038037    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817570-mbhkr"
Sep 10 15:30:04.049344 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:04.049303    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-50fe56-29817570-rzkc9" event={"ID":"9a4c3b3f-e04c-4016-8b39-3a3ece5db0a5","Type":"ContainerDied","Data":"29a6ec1cf564b8d52928e0d0fe74514d88ad660d112d24a4273b695d6c2ef045"}
Sep 10 15:30:04.049523 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:04.049368    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29a6ec1cf564b8d52928e0d0fe74514d88ad660d112d24a4273b695d6c2ef045"
Sep 10 15:30:04.049523 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:04.049432    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-50fe56-29817570-rzkc9"
Sep 10 15:30:04.052176 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:04.052142    2574 generic.go:356] "Generic (PLEG): container finished" podID="6208499f-efbc-4217-b2e6-aa591bc667e6" containerID="b953bde838d7351206980d1db9aa5b120a70cf2a5be734ac3738289ae8b539f1" exitCode=0
Sep 10 15:30:04.052317 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:04.052184    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f5d25c39-gv6w7" event={"ID":"6208499f-efbc-4217-b2e6-aa591bc667e6","Type":"ContainerDied","Data":"b953bde838d7351206980d1db9aa5b120a70cf2a5be734ac3738289ae8b539f1"}
Sep 10 15:30:05.214234 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:05.214209    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f5d25c39-gv6w7"
Sep 10 15:30:05.319149 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:05.319066    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6208499f-efbc-4217-b2e6-aa591bc667e6-maas-api-service-ca\") pod \"6208499f-efbc-4217-b2e6-aa591bc667e6\" (UID: \"6208499f-efbc-4217-b2e6-aa591bc667e6\") "
Sep 10 15:30:05.319451 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:05.319429    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6208499f-efbc-4217-b2e6-aa591bc667e6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6208499f-efbc-4217-b2e6-aa591bc667e6" (UID: "6208499f-efbc-4217-b2e6-aa591bc667e6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:30:05.420869 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:05.420839    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6208499f-efbc-4217-b2e6-aa591bc667e6-maas-api-service-ca\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:30:06.066569 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:06.066527    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f5d25c39-gv6w7" event={"ID":"6208499f-efbc-4217-b2e6-aa591bc667e6","Type":"ContainerDied","Data":"695aa934eb745d0fc5a3f98d012588d88376756a9cc807ec17cbed20f581a319"}
Sep 10 15:30:06.066569 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:06.066560    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f5d25c39-gv6w7"
Sep 10 15:30:06.066775 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:06.066598    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="695aa934eb745d0fc5a3f98d012588d88376756a9cc807ec17cbed20f581a319"
Sep 10 15:30:08.526615 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:08.526204    2574 patch_prober.go:28] interesting pod/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": read tcp 10.133.0.2:57774->10.133.0.55:15021: read: connection reset by peer" start-of-body=
Sep 10 15:30:08.526615 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:08.526272    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4" podUID="7c255ef6-8ddc-4cbe-aac7-b62deb1526c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": read tcp 10.133.0.2:57774->10.133.0.55:15021: read: connection reset by peer"
Sep 10 15:30:09.086831 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:09.086797    2574 generic.go:356] "Generic (PLEG): container finished" podID="7c255ef6-8ddc-4cbe-aac7-b62deb1526c8" containerID="27fd646a7fd030ffe855e91a511c19674ed4988e43ea0dd8252161454273b2b2" exitCode=0
Sep 10 15:30:09.087018 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:09.086841    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4" event={"ID":"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8","Type":"ContainerDied","Data":"27fd646a7fd030ffe855e91a511c19674ed4988e43ea0dd8252161454273b2b2"}
Sep 10 15:30:09.087287 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:09.087273    2574 scope.go:117] "RemoveContainer" containerID="27fd646a7fd030ffe855e91a511c19674ed4988e43ea0dd8252161454273b2b2"
Sep 10 15:30:09.088342 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:09.088308    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:30:09.088443 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:09.088396    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:30:09.088443 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:09.088437    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:30:09.201797 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:09.201754    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f5d25c39-gv6w7"]
Sep 10 15:30:09.203640 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:09.203608    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f5d25c39-gv6w7"]
Sep 10 15:30:09.320916 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:09.320878    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"]
Sep 10 15:30:09.409523 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:09.409448    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6208499f-efbc-4217-b2e6-aa591bc667e6" path="/var/lib/kubelet/pods/6208499f-efbc-4217-b2e6-aa591bc667e6/volumes"
Sep 10 15:30:10.095237 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:10.095198    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4" event={"ID":"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8","Type":"ContainerStarted","Data":"0d3b2f433b4c3f3c3768d8ec58043d83b88fcd8dd966453a9ae8748352156237"}
Sep 10 15:30:10.095705 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:10.095263    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4" podUID="7c255ef6-8ddc-4cbe-aac7-b62deb1526c8" containerName="istio-proxy" containerID="cri-o://0d3b2f433b4c3f3c3768d8ec58043d83b88fcd8dd966453a9ae8748352156237" gracePeriod=30
Sep 10 15:30:12.472740 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:12.472706    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"]
Sep 10 15:30:12.473171 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:12.472943    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl" podUID="872d1243-323b-4d7c-ab11-50e6f8b68dd4" containerName="istio-proxy" containerID="cri-o://44a0172bec7d6c28b2abea3f2546b1f6db5e0ec654af239ee2489f75ab832797" gracePeriod=30
Sep 10 15:30:13.211913 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.211883    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"]
Sep 10 15:30:13.212282 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.212267    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6110a6c-cb82-4b16-a5a5-10191a0796d7" containerName="cleanup"
Sep 10 15:30:13.212326 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.212284    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6110a6c-cb82-4b16-a5a5-10191a0796d7" containerName="cleanup"
Sep 10 15:30:13.212326 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.212301    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a4c3b3f-e04c-4016-8b39-3a3ece5db0a5" containerName="cleanup"
Sep 10 15:30:13.212326 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.212306    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a4c3b3f-e04c-4016-8b39-3a3ece5db0a5" containerName="cleanup"
Sep 10 15:30:13.212326 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.212313    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6208499f-efbc-4217-b2e6-aa591bc667e6" containerName="revoke-keys"
Sep 10 15:30:13.212326 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.212318    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6208499f-efbc-4217-b2e6-aa591bc667e6" containerName="revoke-keys"
Sep 10 15:30:13.212479 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.212386    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6208499f-efbc-4217-b2e6-aa591bc667e6" containerName="revoke-keys"
Sep 10 15:30:13.212479 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.212396    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6110a6c-cb82-4b16-a5a5-10191a0796d7" containerName="cleanup"
Sep 10 15:30:13.212479 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.212403    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a4c3b3f-e04c-4016-8b39-3a3ece5db0a5" containerName="cleanup"
Sep 10 15:30:13.215725 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.215706    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.221246 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.221226    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-57c78a-openshift-default-dockercfg-h2wls\""
Sep 10 15:30:13.229548 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.229525    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"]
Sep 10 15:30:13.300258 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.300225    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a450b043-716b-4336-a82a-da8caa34b3de-istiod-ca-cert\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.300462 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.300264    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-istio-envoy\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.300462 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.300284    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a450b043-716b-4336-a82a-da8caa34b3de-istio-podinfo\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.300462 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.300304    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-workload-certs\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.300462 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.300418    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-istio-data\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.300690 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.300485    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a450b043-716b-4336-a82a-da8caa34b3de-istio-token\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.300690 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.300558    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-credential-socket\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.300690 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.300587    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-workload-socket\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.300690 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.300616    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqvs6\" (UniqueName: \"kubernetes.io/projected/a450b043-716b-4336-a82a-da8caa34b3de-kube-api-access-lqvs6\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.401758 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.401709    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a450b043-716b-4336-a82a-da8caa34b3de-istio-token\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.402124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.402103    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-credential-socket\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.402285 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.402270    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-workload-socket\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.402414 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.402399    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqvs6\" (UniqueName: \"kubernetes.io/projected/a450b043-716b-4336-a82a-da8caa34b3de-kube-api-access-lqvs6\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.402606 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.402576    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-credential-socket\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.410792 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.402580    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a450b043-716b-4336-a82a-da8caa34b3de-istiod-ca-cert\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.411041 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.411019    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-istio-envoy\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.411177 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.411161    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a450b043-716b-4336-a82a-da8caa34b3de-istio-podinfo\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.411305 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.411289    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-workload-certs\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.411483 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.411467    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-istio-data\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.412016 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.411993    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-istio-data\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.412148 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.403054    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-workload-socket\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.414886 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.414864    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-workload-certs\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.415039 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.403774    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a450b043-716b-4336-a82a-da8caa34b3de-istiod-ca-cert\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.420899 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.420726    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-istio-envoy\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.422506 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.422472    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a450b043-716b-4336-a82a-da8caa34b3de-istio-podinfo\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.424410 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.424384    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a450b043-716b-4336-a82a-da8caa34b3de-istio-token\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.426964 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.426912    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqvs6\" (UniqueName: \"kubernetes.io/projected/a450b043-716b-4336-a82a-da8caa34b3de-kube-api-access-lqvs6\") pod \"e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") " pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.526227 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.526142    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:13.807401 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.807373    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"]
Sep 10 15:30:13.809025 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:30:13.809004    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda450b043_716b_4336_a82a_da8caa34b3de.slice/crio-13350429b14aa3a6016a15815f648813c02cda4b0d06e2e5274b21a69e5bc4bf WatchSource:0}: Error finding container 13350429b14aa3a6016a15815f648813c02cda4b0d06e2e5274b21a69e5bc4bf: Status 404 returned error can't find the container with id 13350429b14aa3a6016a15815f648813c02cda4b0d06e2e5274b21a69e5bc4bf
Sep 10 15:30:13.811539 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.811508    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:30:13.811609 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.811578    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:30:13.811647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:13.811607    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:30:14.121572 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:14.121481    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8" event={"ID":"a450b043-716b-4336-a82a-da8caa34b3de","Type":"ContainerStarted","Data":"f75ada97dee02212614cd1b255b5d43b0acf69c8add5e547e0ecf68adc7178f8"}
Sep 10 15:30:14.121572 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:14.121529    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8" event={"ID":"a450b043-716b-4336-a82a-da8caa34b3de","Type":"ContainerStarted","Data":"13350429b14aa3a6016a15815f648813c02cda4b0d06e2e5274b21a69e5bc4bf"}
Sep 10 15:30:14.149564 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:14.149490    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8" podStartSLOduration=1.149469363 podStartE2EDuration="1.149469363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:30:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:30:14.144184552 +0000 UTC m=+867.193983086" watchObservedRunningTime="2026-09-10 15:30:14.149469363 +0000 UTC m=+867.199267873"
Sep 10 15:30:14.526816 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:14.526722    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:14.528342 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:14.528314    2574 patch_prober.go:28] interesting pod/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 10 15:30:14.528473 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:14.528377    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8" podUID="a450b043-716b-4336-a82a-da8caa34b3de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 10 15:30:15.364314 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.364287    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:30:15.431783 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.431709    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-data\") pod \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") "
Sep 10 15:30:15.431783 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.431754    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8cvz\" (UniqueName: \"kubernetes.io/projected/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-kube-api-access-k8cvz\") pod \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") "
Sep 10 15:30:15.431783 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.431780    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-podinfo\") pod \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") "
Sep 10 15:30:15.432105 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.431809    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-workload-socket\") pod \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") "
Sep 10 15:30:15.432105 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.431855    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-token\") pod \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") "
Sep 10 15:30:15.432105 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.431880    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istiod-ca-cert\") pod \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") "
Sep 10 15:30:15.432105 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.431917    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-workload-certs\") pod \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") "
Sep 10 15:30:15.432105 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.431954    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-envoy\") pod \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") "
Sep 10 15:30:15.432105 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.432001    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-credential-socket\") pod \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\" (UID: \"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8\") "
Sep 10 15:30:15.432105 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.432038    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-data" (OuterVolumeSpecName: "istio-data") pod "7c255ef6-8ddc-4cbe-aac7-b62deb1526c8" (UID: "7c255ef6-8ddc-4cbe-aac7-b62deb1526c8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:30:15.432752 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.432126    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7c255ef6-8ddc-4cbe-aac7-b62deb1526c8" (UID: "7c255ef6-8ddc-4cbe-aac7-b62deb1526c8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:30:15.432752 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.432234    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7c255ef6-8ddc-4cbe-aac7-b62deb1526c8" (UID: "7c255ef6-8ddc-4cbe-aac7-b62deb1526c8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:30:15.432752 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.432326    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7c255ef6-8ddc-4cbe-aac7-b62deb1526c8" (UID: "7c255ef6-8ddc-4cbe-aac7-b62deb1526c8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:30:15.432752 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.432478    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-workload-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:30:15.432752 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.432498    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-workload-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:30:15.432752 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.432513    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-credential-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:30:15.432752 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.432531    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-data\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:30:15.432752 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.432612    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7c255ef6-8ddc-4cbe-aac7-b62deb1526c8" (UID: "7c255ef6-8ddc-4cbe-aac7-b62deb1526c8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:30:15.434462 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.434437    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7c255ef6-8ddc-4cbe-aac7-b62deb1526c8" (UID: "7c255ef6-8ddc-4cbe-aac7-b62deb1526c8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:30:15.434462 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.434444    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-token" (OuterVolumeSpecName: "istio-token") pod "7c255ef6-8ddc-4cbe-aac7-b62deb1526c8" (UID: "7c255ef6-8ddc-4cbe-aac7-b62deb1526c8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:30:15.434602 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.434460    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-kube-api-access-k8cvz" (OuterVolumeSpecName: "kube-api-access-k8cvz") pod "7c255ef6-8ddc-4cbe-aac7-b62deb1526c8" (UID: "7c255ef6-8ddc-4cbe-aac7-b62deb1526c8"). InnerVolumeSpecName "kube-api-access-k8cvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:30:15.434602 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.434577    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7c255ef6-8ddc-4cbe-aac7-b62deb1526c8" (UID: "7c255ef6-8ddc-4cbe-aac7-b62deb1526c8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:30:15.531650 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.531617    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:15.533063 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.533045    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8cvz\" (UniqueName: \"kubernetes.io/projected/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-kube-api-access-k8cvz\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:30:15.533124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.533066    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-podinfo\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:30:15.533124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.533077    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-token\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:30:15.533124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.533085    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istiod-ca-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:30:15.533124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:15.533092    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8-istio-envoy\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:30:16.135052 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:16.135013    2574 generic.go:356] "Generic (PLEG): container finished" podID="7c255ef6-8ddc-4cbe-aac7-b62deb1526c8" containerID="0d3b2f433b4c3f3c3768d8ec58043d83b88fcd8dd966453a9ae8748352156237" exitCode=0
Sep 10 15:30:16.135231 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:16.135063    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"
Sep 10 15:30:16.135231 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:16.135097    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4" event={"ID":"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8","Type":"ContainerDied","Data":"0d3b2f433b4c3f3c3768d8ec58043d83b88fcd8dd966453a9ae8748352156237"}
Sep 10 15:30:16.135231 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:16.135157    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4" event={"ID":"7c255ef6-8ddc-4cbe-aac7-b62deb1526c8","Type":"ContainerDied","Data":"08ece520090bda0d07b53b0cf8af6720777ce57ee39c33ea8100d454e5526696"}
Sep 10 15:30:16.135231 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:16.135181    2574 scope.go:117] "RemoveContainer" containerID="0d3b2f433b4c3f3c3768d8ec58043d83b88fcd8dd966453a9ae8748352156237"
Sep 10 15:30:16.135516 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:16.135494    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:16.136705 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:16.136689    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:16.145740 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:16.145725    2574 scope.go:117] "RemoveContainer" containerID="27fd646a7fd030ffe855e91a511c19674ed4988e43ea0dd8252161454273b2b2"
Sep 10 15:30:16.156989 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:16.156966    2574 scope.go:117] "RemoveContainer" containerID="0d3b2f433b4c3f3c3768d8ec58043d83b88fcd8dd966453a9ae8748352156237"
Sep 10 15:30:16.157301 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:30:16.157281    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d3b2f433b4c3f3c3768d8ec58043d83b88fcd8dd966453a9ae8748352156237\": container with ID starting with 0d3b2f433b4c3f3c3768d8ec58043d83b88fcd8dd966453a9ae8748352156237 not found: ID does not exist" containerID="0d3b2f433b4c3f3c3768d8ec58043d83b88fcd8dd966453a9ae8748352156237"
Sep 10 15:30:16.157368 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:16.157309    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d3b2f433b4c3f3c3768d8ec58043d83b88fcd8dd966453a9ae8748352156237"} err="failed to get container status \"0d3b2f433b4c3f3c3768d8ec58043d83b88fcd8dd966453a9ae8748352156237\": rpc error: code = NotFound desc = could not find container \"0d3b2f433b4c3f3c3768d8ec58043d83b88fcd8dd966453a9ae8748352156237\": container with ID starting with 0d3b2f433b4c3f3c3768d8ec58043d83b88fcd8dd966453a9ae8748352156237 not found: ID does not exist"
Sep 10 15:30:16.157368 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:16.157326    2574 scope.go:117] "RemoveContainer" containerID="27fd646a7fd030ffe855e91a511c19674ed4988e43ea0dd8252161454273b2b2"
Sep 10 15:30:16.157590 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:30:16.157573    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27fd646a7fd030ffe855e91a511c19674ed4988e43ea0dd8252161454273b2b2\": container with ID starting with 27fd646a7fd030ffe855e91a511c19674ed4988e43ea0dd8252161454273b2b2 not found: ID does not exist" containerID="27fd646a7fd030ffe855e91a511c19674ed4988e43ea0dd8252161454273b2b2"
Sep 10 15:30:16.157628 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:16.157599    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27fd646a7fd030ffe855e91a511c19674ed4988e43ea0dd8252161454273b2b2"} err="failed to get container status \"27fd646a7fd030ffe855e91a511c19674ed4988e43ea0dd8252161454273b2b2\": rpc error: code = NotFound desc = could not find container \"27fd646a7fd030ffe855e91a511c19674ed4988e43ea0dd8252161454273b2b2\": container with ID starting with 27fd646a7fd030ffe855e91a511c19674ed4988e43ea0dd8252161454273b2b2 not found: ID does not exist"
Sep 10 15:30:16.186468 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:16.186429    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"]
Sep 10 15:30:16.190167 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:16.190133    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f5d25c39-openshift-default-5dc54dcdc6-q6fl4"]
Sep 10 15:30:17.411022 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.410991    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c255ef6-8ddc-4cbe-aac7-b62deb1526c8" path="/var/lib/kubelet/pods/7c255ef6-8ddc-4cbe-aac7-b62deb1526c8/volumes"
Sep 10 15:30:17.737530 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.737505    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:30:17.856971 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.856908    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istiod-ca-cert\") pod \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") "
Sep 10 15:30:17.857169 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.856986    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kps4z\" (UniqueName: \"kubernetes.io/projected/872d1243-323b-4d7c-ab11-50e6f8b68dd4-kube-api-access-kps4z\") pod \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") "
Sep 10 15:30:17.857169 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.857015    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-token\") pod \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") "
Sep 10 15:30:17.857169 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.857046    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-workload-certs\") pod \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") "
Sep 10 15:30:17.857169 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.857078    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-envoy\") pod \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") "
Sep 10 15:30:17.857169 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.857158    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-podinfo\") pod \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") "
Sep 10 15:30:17.857676 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.857250    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-credential-socket\") pod \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") "
Sep 10 15:30:17.857676 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.857283    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-data\") pod \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") "
Sep 10 15:30:17.857676 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.857313    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-workload-socket\") pod \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\" (UID: \"872d1243-323b-4d7c-ab11-50e6f8b68dd4\") "
Sep 10 15:30:17.857676 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.857355    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "872d1243-323b-4d7c-ab11-50e6f8b68dd4" (UID: "872d1243-323b-4d7c-ab11-50e6f8b68dd4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:30:17.857676 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.857615    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-data" (OuterVolumeSpecName: "istio-data") pod "872d1243-323b-4d7c-ab11-50e6f8b68dd4" (UID: "872d1243-323b-4d7c-ab11-50e6f8b68dd4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:30:17.858023 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.857715    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-data\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:30:17.858023 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.857733    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istiod-ca-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:30:17.858023 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.857799    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "872d1243-323b-4d7c-ab11-50e6f8b68dd4" (UID: "872d1243-323b-4d7c-ab11-50e6f8b68dd4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:30:17.858023 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.857901    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "872d1243-323b-4d7c-ab11-50e6f8b68dd4" (UID: "872d1243-323b-4d7c-ab11-50e6f8b68dd4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:30:17.858246 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.858031    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "872d1243-323b-4d7c-ab11-50e6f8b68dd4" (UID: "872d1243-323b-4d7c-ab11-50e6f8b68dd4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:30:17.859330 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.859306    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/872d1243-323b-4d7c-ab11-50e6f8b68dd4-kube-api-access-kps4z" (OuterVolumeSpecName: "kube-api-access-kps4z") pod "872d1243-323b-4d7c-ab11-50e6f8b68dd4" (UID: "872d1243-323b-4d7c-ab11-50e6f8b68dd4"). InnerVolumeSpecName "kube-api-access-kps4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:30:17.859486 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.859461    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "872d1243-323b-4d7c-ab11-50e6f8b68dd4" (UID: "872d1243-323b-4d7c-ab11-50e6f8b68dd4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:30:17.859581 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.859528    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "872d1243-323b-4d7c-ab11-50e6f8b68dd4" (UID: "872d1243-323b-4d7c-ab11-50e6f8b68dd4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:30:17.859697 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.859673    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-token" (OuterVolumeSpecName: "istio-token") pod "872d1243-323b-4d7c-ab11-50e6f8b68dd4" (UID: "872d1243-323b-4d7c-ab11-50e6f8b68dd4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:30:17.959143 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.959105    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kps4z\" (UniqueName: \"kubernetes.io/projected/872d1243-323b-4d7c-ab11-50e6f8b68dd4-kube-api-access-kps4z\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:30:17.959143 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.959141    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-token\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:30:17.959143 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.959151    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-workload-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:30:17.959385 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.959158    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-envoy\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:30:17.959385 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.959167    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/872d1243-323b-4d7c-ab11-50e6f8b68dd4-istio-podinfo\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:30:17.959385 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.959174    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-credential-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:30:17.959385 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:17.959182    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/872d1243-323b-4d7c-ab11-50e6f8b68dd4-workload-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:30:18.149118 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:18.149077    2574 generic.go:356] "Generic (PLEG): container finished" podID="872d1243-323b-4d7c-ab11-50e6f8b68dd4" containerID="44a0172bec7d6c28b2abea3f2546b1f6db5e0ec654af239ee2489f75ab832797" exitCode=0
Sep 10 15:30:18.149290 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:18.149130    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"
Sep 10 15:30:18.149290 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:18.149166    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl" event={"ID":"872d1243-323b-4d7c-ab11-50e6f8b68dd4","Type":"ContainerDied","Data":"44a0172bec7d6c28b2abea3f2546b1f6db5e0ec654af239ee2489f75ab832797"}
Sep 10 15:30:18.149290 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:18.149226    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl" event={"ID":"872d1243-323b-4d7c-ab11-50e6f8b68dd4","Type":"ContainerDied","Data":"255c2735703ede2f79ea9d2af44a7b8f6f3a71449746f71b7f2f7ad932f3fda0"}
Sep 10 15:30:18.149290 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:18.149251    2574 scope.go:117] "RemoveContainer" containerID="44a0172bec7d6c28b2abea3f2546b1f6db5e0ec654af239ee2489f75ab832797"
Sep 10 15:30:18.166162 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:18.166141    2574 scope.go:117] "RemoveContainer" containerID="8a7043c4777df9afc9e691fec6d75a0d6c24e8757d2040996568f09c0e097e99"
Sep 10 15:30:18.175073 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:18.175050    2574 scope.go:117] "RemoveContainer" containerID="44a0172bec7d6c28b2abea3f2546b1f6db5e0ec654af239ee2489f75ab832797"
Sep 10 15:30:18.175335 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:30:18.175316    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44a0172bec7d6c28b2abea3f2546b1f6db5e0ec654af239ee2489f75ab832797\": container with ID starting with 44a0172bec7d6c28b2abea3f2546b1f6db5e0ec654af239ee2489f75ab832797 not found: ID does not exist" containerID="44a0172bec7d6c28b2abea3f2546b1f6db5e0ec654af239ee2489f75ab832797"
Sep 10 15:30:18.175393 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:18.175341    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44a0172bec7d6c28b2abea3f2546b1f6db5e0ec654af239ee2489f75ab832797"} err="failed to get container status \"44a0172bec7d6c28b2abea3f2546b1f6db5e0ec654af239ee2489f75ab832797\": rpc error: code = NotFound desc = could not find container \"44a0172bec7d6c28b2abea3f2546b1f6db5e0ec654af239ee2489f75ab832797\": container with ID starting with 44a0172bec7d6c28b2abea3f2546b1f6db5e0ec654af239ee2489f75ab832797 not found: ID does not exist"
Sep 10 15:30:18.175393 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:18.175356    2574 scope.go:117] "RemoveContainer" containerID="8a7043c4777df9afc9e691fec6d75a0d6c24e8757d2040996568f09c0e097e99"
Sep 10 15:30:18.175590 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:30:18.175573    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a7043c4777df9afc9e691fec6d75a0d6c24e8757d2040996568f09c0e097e99\": container with ID starting with 8a7043c4777df9afc9e691fec6d75a0d6c24e8757d2040996568f09c0e097e99 not found: ID does not exist" containerID="8a7043c4777df9afc9e691fec6d75a0d6c24e8757d2040996568f09c0e097e99"
Sep 10 15:30:18.175634 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:18.175595    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a7043c4777df9afc9e691fec6d75a0d6c24e8757d2040996568f09c0e097e99"} err="failed to get container status \"8a7043c4777df9afc9e691fec6d75a0d6c24e8757d2040996568f09c0e097e99\": rpc error: code = NotFound desc = could not find container \"8a7043c4777df9afc9e691fec6d75a0d6c24e8757d2040996568f09c0e097e99\": container with ID starting with 8a7043c4777df9afc9e691fec6d75a0d6c24e8757d2040996568f09c0e097e99 not found: ID does not exist"
Sep 10 15:30:18.180427 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:18.180405    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"]
Sep 10 15:30:18.189968 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:18.189940    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-2e2b69-openshift-default-54c7d5d486-kc7cl"]
Sep 10 15:30:19.410051 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:19.410017    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="872d1243-323b-4d7c-ab11-50e6f8b68dd4" path="/var/lib/kubelet/pods/872d1243-323b-4d7c-ab11-50e6f8b68dd4/volumes"
Sep 10 15:30:36.262043 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:36.261954    2574 generic.go:356] "Generic (PLEG): container finished" podID="a450b043-716b-4336-a82a-da8caa34b3de" containerID="f75ada97dee02212614cd1b255b5d43b0acf69c8add5e547e0ecf68adc7178f8" exitCode=0
Sep 10 15:30:36.262043 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:36.262004    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8" event={"ID":"a450b043-716b-4336-a82a-da8caa34b3de","Type":"ContainerDied","Data":"f75ada97dee02212614cd1b255b5d43b0acf69c8add5e547e0ecf68adc7178f8"}
Sep 10 15:30:36.262502 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:36.262464    2574 scope.go:117] "RemoveContainer" containerID="f75ada97dee02212614cd1b255b5d43b0acf69c8add5e547e0ecf68adc7178f8"
Sep 10 15:30:36.263561 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:36.263530    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:30:36.263676 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:36.263598    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:30:36.263676 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:36.263627    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:30:37.271229 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:37.271143    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8" event={"ID":"a450b043-716b-4336-a82a-da8caa34b3de","Type":"ContainerStarted","Data":"df56aab244b38e1e29f5e37e928cc660efd71f613672b7da3a5be4b19bb6e3f6"}
Sep 10 15:30:37.526988 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:37.526888    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:37.535158 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:37.535117    2574 patch_prober.go:28] interesting pod/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 10 15:30:37.535425 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:37.535394    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8" podUID="a450b043-716b-4336-a82a-da8caa34b3de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 10 15:30:38.526512 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:38.526471    2574 patch_prober.go:28] interesting pod/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 10 15:30:38.526952 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:38.526558    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8" podUID="a450b043-716b-4336-a82a-da8caa34b3de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 10 15:30:39.527563 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:39.527525    2574 patch_prober.go:28] interesting pod/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 10 15:30:39.528013 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:39.527581    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8" podUID="a450b043-716b-4336-a82a-da8caa34b3de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 10 15:30:40.527349 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:40.527308    2574 patch_prober.go:28] interesting pod/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 10 15:30:40.527552 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:40.527385    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8" podUID="a450b043-716b-4336-a82a-da8caa34b3de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 10 15:30:41.527158 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:41.527118    2574 patch_prober.go:28] interesting pod/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 10 15:30:41.527580 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:41.527189    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8" podUID="a450b043-716b-4336-a82a-da8caa34b3de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 10 15:30:42.526683 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:42.526646    2574 patch_prober.go:28] interesting pod/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 10 15:30:42.526865 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:42.526700    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8" podUID="a450b043-716b-4336-a82a-da8caa34b3de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 10 15:30:43.531085 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:43.531052    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:43.531501 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:43.531372    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:43.532004 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:43.531985    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:30:47.403421 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:47.403387    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/2.log"
Sep 10 15:30:47.406321 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:30:47.406292    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/2.log"
Sep 10 15:31:04.686531 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.686494    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"]
Sep 10 15:31:04.687009 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.686860    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c255ef6-8ddc-4cbe-aac7-b62deb1526c8" containerName="istio-proxy"
Sep 10 15:31:04.687009 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.686872    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c255ef6-8ddc-4cbe-aac7-b62deb1526c8" containerName="istio-proxy"
Sep 10 15:31:04.687009 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.686889    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c255ef6-8ddc-4cbe-aac7-b62deb1526c8" containerName="istio-proxy"
Sep 10 15:31:04.687009 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.686894    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c255ef6-8ddc-4cbe-aac7-b62deb1526c8" containerName="istio-proxy"
Sep 10 15:31:04.687009 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.686901    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="872d1243-323b-4d7c-ab11-50e6f8b68dd4" containerName="istio-proxy"
Sep 10 15:31:04.687009 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.686907    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="872d1243-323b-4d7c-ab11-50e6f8b68dd4" containerName="istio-proxy"
Sep 10 15:31:04.687009 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.686999    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c255ef6-8ddc-4cbe-aac7-b62deb1526c8" containerName="istio-proxy"
Sep 10 15:31:04.687009 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.687009    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c255ef6-8ddc-4cbe-aac7-b62deb1526c8" containerName="istio-proxy"
Sep 10 15:31:04.687271 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.687016    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="872d1243-323b-4d7c-ab11-50e6f8b68dd4" containerName="istio-proxy"
Sep 10 15:31:04.687271 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.687022    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="872d1243-323b-4d7c-ab11-50e6f8b68dd4" containerName="istio-proxy"
Sep 10 15:31:04.691481 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.691463    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:04.701817 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.701794    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-57c78a\"/\"default-dockercfg-rzmng\""
Sep 10 15:31:04.701817 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.701806    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-57c78a\"/\"openshift-service-ca.crt\""
Sep 10 15:31:04.702000 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.701795    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-57c78a\"/\"kube-root-ca.crt\""
Sep 10 15:31:04.702571 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.702556    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-57c78a\"/\"explicit-model-57c78a-kserve-self-signed-certs\""
Sep 10 15:31:04.719257 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.719229    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-model-cache\") pod \"explicit-model-57c78a-kserve-74f9b7579f-6n5jx\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") " pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:04.719352 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.719290    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-tls-certs\") pod \"explicit-model-57c78a-kserve-74f9b7579f-6n5jx\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") " pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:04.719352 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.719336    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-dshm\") pod \"explicit-model-57c78a-kserve-74f9b7579f-6n5jx\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") " pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:04.719423 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.719365    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-tmp-dir\") pod \"explicit-model-57c78a-kserve-74f9b7579f-6n5jx\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") " pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:04.719423 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.719390    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l48xv\" (UniqueName: \"kubernetes.io/projected/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-kube-api-access-l48xv\") pod \"explicit-model-57c78a-kserve-74f9b7579f-6n5jx\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") " pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:04.719495 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.719420    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-home\") pod \"explicit-model-57c78a-kserve-74f9b7579f-6n5jx\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") " pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:04.733352 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.733311    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"]
Sep 10 15:31:04.821389 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.821345    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l48xv\" (UniqueName: \"kubernetes.io/projected/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-kube-api-access-l48xv\") pod \"explicit-model-57c78a-kserve-74f9b7579f-6n5jx\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") " pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:04.821596 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.821434    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-home\") pod \"explicit-model-57c78a-kserve-74f9b7579f-6n5jx\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") " pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:04.821596 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.821491    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-model-cache\") pod \"explicit-model-57c78a-kserve-74f9b7579f-6n5jx\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") " pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:04.821596 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.821569    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-tls-certs\") pod \"explicit-model-57c78a-kserve-74f9b7579f-6n5jx\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") " pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:04.821776 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.821657    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-dshm\") pod \"explicit-model-57c78a-kserve-74f9b7579f-6n5jx\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") " pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:04.821776 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.821691    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-tmp-dir\") pod \"explicit-model-57c78a-kserve-74f9b7579f-6n5jx\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") " pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:04.821989 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.821965    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-home\") pod \"explicit-model-57c78a-kserve-74f9b7579f-6n5jx\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") " pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:04.822144 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.822118    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-model-cache\") pod \"explicit-model-57c78a-kserve-74f9b7579f-6n5jx\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") " pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:04.822243 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.822189    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-tmp-dir\") pod \"explicit-model-57c78a-kserve-74f9b7579f-6n5jx\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") " pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:04.824326 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.824306    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-dshm\") pod \"explicit-model-57c78a-kserve-74f9b7579f-6n5jx\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") " pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:04.824476 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.824458    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-tls-certs\") pod \"explicit-model-57c78a-kserve-74f9b7579f-6n5jx\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") " pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:04.841305 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:04.841273    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l48xv\" (UniqueName: \"kubernetes.io/projected/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-kube-api-access-l48xv\") pod \"explicit-model-57c78a-kserve-74f9b7579f-6n5jx\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") " pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:05.000500 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:05.000413    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:05.280253 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:05.280227    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"]
Sep 10 15:31:05.281903 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:31:05.281876    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9156cf89_fb14_4b4e_87a4_aa0d0fbcbf1a.slice/crio-a15e98331e6d067005d5f01708e01900137a1c119cb31e946af0338327d98b40 WatchSource:0}: Error finding container a15e98331e6d067005d5f01708e01900137a1c119cb31e946af0338327d98b40: Status 404 returned error can't find the container with id a15e98331e6d067005d5f01708e01900137a1c119cb31e946af0338327d98b40
Sep 10 15:31:05.444580 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:05.444541    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx" event={"ID":"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a","Type":"ContainerStarted","Data":"def09799ade761a8f34f3513ff2a5f5776352a57267ea9235f540551775c19f4"}
Sep 10 15:31:05.444580 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:05.444584    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx" event={"ID":"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a","Type":"ContainerStarted","Data":"a15e98331e6d067005d5f01708e01900137a1c119cb31e946af0338327d98b40"}
Sep 10 15:31:05.466538 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:05.466487    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx" podStartSLOduration=1.466470556 podStartE2EDuration="1.466470556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:31:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:31:05.464865975 +0000 UTC m=+918.514664483" watchObservedRunningTime="2026-09-10 15:31:05.466470556 +0000 UTC m=+918.516269064"
Sep 10 15:31:15.001044 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:15.001006    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:15.001516 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:15.001257    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:15.014917 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:15.014891    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:15.519107 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:15.519068    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:22.213443 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:22.213404    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"]
Sep 10 15:31:22.400454 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:22.400408    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-57c78a-77jnc"]
Sep 10 15:31:22.400911 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:22.400892    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="872d1243-323b-4d7c-ab11-50e6f8b68dd4" containerName="istio-proxy"
Sep 10 15:31:22.401061 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:22.400913    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="872d1243-323b-4d7c-ab11-50e6f8b68dd4" containerName="istio-proxy"
Sep 10 15:31:22.404156 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:22.404130    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-57c78a-77jnc"
Sep 10 15:31:22.408421 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:22.408399    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 15:31:22.408599 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:22.408582    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zzl2g\""
Sep 10 15:31:22.425097 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:22.425063    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-57c78a-77jnc"]
Sep 10 15:31:22.487904 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:22.487813    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c913617c-a851-43ce-b31e-b49b53189e45-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-57c78a-77jnc\" (UID: \"c913617c-a851-43ce-b31e-b49b53189e45\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-57c78a-77jnc"
Sep 10 15:31:22.588553 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:22.588513    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c913617c-a851-43ce-b31e-b49b53189e45-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-57c78a-77jnc\" (UID: \"c913617c-a851-43ce-b31e-b49b53189e45\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-57c78a-77jnc"
Sep 10 15:31:22.589224 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:22.589204    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c913617c-a851-43ce-b31e-b49b53189e45-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-57c78a-77jnc\" (UID: \"c913617c-a851-43ce-b31e-b49b53189e45\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-57c78a-77jnc"
Sep 10 15:31:22.715479 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:22.715426    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-57c78a-77jnc"
Sep 10 15:31:22.992442 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:22.992414    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-57c78a-77jnc"]
Sep 10 15:31:22.993805 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:31:22.993775    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc913617c_a851_43ce_b31e_b49b53189e45.slice/crio-352dbebaad30255f41b57b3d31f6cf96000087e1b3b7278fba9b90d0b57998d5 WatchSource:0}: Error finding container 352dbebaad30255f41b57b3d31f6cf96000087e1b3b7278fba9b90d0b57998d5: Status 404 returned error can't find the container with id 352dbebaad30255f41b57b3d31f6cf96000087e1b3b7278fba9b90d0b57998d5
Sep 10 15:31:23.554812 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:23.554773    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-57c78a-77jnc" event={"ID":"c913617c-a851-43ce-b31e-b49b53189e45","Type":"ContainerStarted","Data":"6812d8da93341a3fcb5539de44a7caff39783cea9cc046398f0179bef361c1b4"}
Sep 10 15:31:23.555226 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:23.554822    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-57c78a-77jnc" event={"ID":"c913617c-a851-43ce-b31e-b49b53189e45","Type":"ContainerStarted","Data":"352dbebaad30255f41b57b3d31f6cf96000087e1b3b7278fba9b90d0b57998d5"}
Sep 10 15:31:23.573048 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:23.573002    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-57c78a-77jnc" podStartSLOduration=1.572984887 podStartE2EDuration="1.572984887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:31:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:31:23.571736996 +0000 UTC m=+936.621535505" watchObservedRunningTime="2026-09-10 15:31:23.572984887 +0000 UTC m=+936.622783395"
Sep 10 15:31:24.562366 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:24.562328    2574 generic.go:356] "Generic (PLEG): container finished" podID="c913617c-a851-43ce-b31e-b49b53189e45" containerID="6812d8da93341a3fcb5539de44a7caff39783cea9cc046398f0179bef361c1b4" exitCode=0
Sep 10 15:31:24.562733 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:24.562414    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-57c78a-77jnc" event={"ID":"c913617c-a851-43ce-b31e-b49b53189e45","Type":"ContainerDied","Data":"6812d8da93341a3fcb5539de44a7caff39783cea9cc046398f0179bef361c1b4"}
Sep 10 15:31:25.697271 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:25.697246    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-57c78a-77jnc"
Sep 10 15:31:25.819748 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:25.819658    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c913617c-a851-43ce-b31e-b49b53189e45-maas-api-service-ca\") pod \"c913617c-a851-43ce-b31e-b49b53189e45\" (UID: \"c913617c-a851-43ce-b31e-b49b53189e45\") "
Sep 10 15:31:25.820062 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:25.820038    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c913617c-a851-43ce-b31e-b49b53189e45-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c913617c-a851-43ce-b31e-b49b53189e45" (UID: "c913617c-a851-43ce-b31e-b49b53189e45"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:31:25.921381 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:25.921342    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c913617c-a851-43ce-b31e-b49b53189e45-maas-api-service-ca\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:31:26.575034 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:26.574995    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-57c78a-77jnc"
Sep 10 15:31:26.575034 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:26.575019    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-57c78a-77jnc" event={"ID":"c913617c-a851-43ce-b31e-b49b53189e45","Type":"ContainerDied","Data":"352dbebaad30255f41b57b3d31f6cf96000087e1b3b7278fba9b90d0b57998d5"}
Sep 10 15:31:26.575246 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:26.575069    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="352dbebaad30255f41b57b3d31f6cf96000087e1b3b7278fba9b90d0b57998d5"
Sep 10 15:31:33.468293 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:33.468256    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-57c78a-77jnc"]
Sep 10 15:31:33.480839 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:33.480814    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-57c78a-77jnc"]
Sep 10 15:31:35.409650 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:35.409616    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c913617c-a851-43ce-b31e-b49b53189e45" path="/var/lib/kubelet/pods/c913617c-a851-43ce-b31e-b49b53189e45/volumes"
Sep 10 15:31:37.233623 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.233582    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx" podUID="9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a" containerName="main" containerID="cri-o://def09799ade761a8f34f3513ff2a5f5776352a57267ea9235f540551775c19f4" gracePeriod=45
Sep 10 15:31:37.482536 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.482508    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:37.641833 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.641800    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-tls-certs\") pod \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") "
Sep 10 15:31:37.642066 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.641918    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-tmp-dir\") pod \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") "
Sep 10 15:31:37.642066 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.641983    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-home\") pod \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") "
Sep 10 15:31:37.642066 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.642039    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-model-cache\") pod \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") "
Sep 10 15:31:37.642242 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.642095    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l48xv\" (UniqueName: \"kubernetes.io/projected/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-kube-api-access-l48xv\") pod \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") "
Sep 10 15:31:37.642242 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.642127    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-dshm\") pod \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\" (UID: \"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a\") "
Sep 10 15:31:37.642242 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.642190    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a" (UID: "9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:31:37.642419 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.642269    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-home" (OuterVolumeSpecName: "home") pod "9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a" (UID: "9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:31:37.642419 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.642282    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-model-cache" (OuterVolumeSpecName: "model-cache") pod "9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a" (UID: "9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:31:37.642525 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.642467    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-tmp-dir\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:31:37.642525 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.642481    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-home\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:31:37.642525 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.642494    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-model-cache\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:31:37.644198 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.644159    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a" (UID: "9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:31:37.644324 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.644236    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-dshm" (OuterVolumeSpecName: "dshm") pod "9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a" (UID: "9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:31:37.644324 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.644263    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-kube-api-access-l48xv" (OuterVolumeSpecName: "kube-api-access-l48xv") pod "9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a" (UID: "9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a"). InnerVolumeSpecName "kube-api-access-l48xv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:31:37.650260 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.650225    2574 generic.go:356] "Generic (PLEG): container finished" podID="9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a" containerID="def09799ade761a8f34f3513ff2a5f5776352a57267ea9235f540551775c19f4" exitCode=0
Sep 10 15:31:37.650373 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.650278    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"
Sep 10 15:31:37.650373 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.650311    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx" event={"ID":"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a","Type":"ContainerDied","Data":"def09799ade761a8f34f3513ff2a5f5776352a57267ea9235f540551775c19f4"}
Sep 10 15:31:37.650373 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.650357    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx" event={"ID":"9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a","Type":"ContainerDied","Data":"a15e98331e6d067005d5f01708e01900137a1c119cb31e946af0338327d98b40"}
Sep 10 15:31:37.650480 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.650375    2574 scope.go:117] "RemoveContainer" containerID="def09799ade761a8f34f3513ff2a5f5776352a57267ea9235f540551775c19f4"
Sep 10 15:31:37.665023 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.665006    2574 scope.go:117] "RemoveContainer" containerID="def09799ade761a8f34f3513ff2a5f5776352a57267ea9235f540551775c19f4"
Sep 10 15:31:37.665290 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:31:37.665272    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"def09799ade761a8f34f3513ff2a5f5776352a57267ea9235f540551775c19f4\": container with ID starting with def09799ade761a8f34f3513ff2a5f5776352a57267ea9235f540551775c19f4 not found: ID does not exist" containerID="def09799ade761a8f34f3513ff2a5f5776352a57267ea9235f540551775c19f4"
Sep 10 15:31:37.665366 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.665299    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"def09799ade761a8f34f3513ff2a5f5776352a57267ea9235f540551775c19f4"} err="failed to get container status \"def09799ade761a8f34f3513ff2a5f5776352a57267ea9235f540551775c19f4\": rpc error: code = NotFound desc = could not find container \"def09799ade761a8f34f3513ff2a5f5776352a57267ea9235f540551775c19f4\": container with ID starting with def09799ade761a8f34f3513ff2a5f5776352a57267ea9235f540551775c19f4 not found: ID does not exist"
Sep 10 15:31:37.678277 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.678247    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"]
Sep 10 15:31:37.683737 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.683712    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-57c78a/explicit-model-57c78a-kserve-74f9b7579f-6n5jx"]
Sep 10 15:31:37.743389 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.743356    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-dshm\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:31:37.743389 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.743386    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-tls-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:31:37.743601 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:37.743401    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l48xv\" (UniqueName: \"kubernetes.io/projected/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a-kube-api-access-l48xv\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:31:39.410402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:39.410362    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a" path="/var/lib/kubelet/pods/9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a/volumes"
Sep 10 15:31:40.480484 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:40.480453    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"]
Sep 10 15:31:40.480921 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:40.480759    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8" podUID="a450b043-716b-4336-a82a-da8caa34b3de" containerName="istio-proxy" containerID="cri-o://df56aab244b38e1e29f5e37e928cc660efd71f613672b7da3a5be4b19bb6e3f6" gracePeriod=30
Sep 10 15:31:41.215789 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.215754    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"]
Sep 10 15:31:41.216182 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.216167    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a" containerName="main"
Sep 10 15:31:41.216236 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.216184    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a" containerName="main"
Sep 10 15:31:41.216236 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.216206    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c913617c-a851-43ce-b31e-b49b53189e45" containerName="revoke-keys"
Sep 10 15:31:41.216236 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.216212    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c913617c-a851-43ce-b31e-b49b53189e45" containerName="revoke-keys"
Sep 10 15:31:41.216328 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.216277    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9156cf89-fb14-4b4e-87a4-aa0d0fbcbf1a" containerName="main"
Sep 10 15:31:41.216328 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.216289    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c913617c-a851-43ce-b31e-b49b53189e45" containerName="revoke-keys"
Sep 10 15:31:41.220843 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.220818    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.235544 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.235521    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-6c22f6-openshift-default-dockercfg-krnrf\""
Sep 10 15:31:41.244631 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.244604    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"]
Sep 10 15:31:41.381923 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.381861    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-workload-certs\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.382153 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.381966    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-workload-socket\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.382153 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.382029    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-podinfo\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.382153 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.382073    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-credential-socket\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.382153 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.382095    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istiod-ca-cert\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.382153 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.382122    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-token\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.382435 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.382198    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-data\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.382435 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.382225    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-envoy\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.382435 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.382317    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m7xt\" (UniqueName: \"kubernetes.io/projected/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-kube-api-access-6m7xt\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.483973 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.483848    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-data\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.483973 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.483890    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-envoy\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.484591 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.483993    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m7xt\" (UniqueName: \"kubernetes.io/projected/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-kube-api-access-6m7xt\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.484591 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.484032    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-workload-certs\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.484591 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.484067    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-workload-socket\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.484591 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.484122    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-podinfo\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.484591 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.484169    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-credential-socket\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.484591 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.484194    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istiod-ca-cert\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.484591 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.484222    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-token\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.484591 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.484558    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-workload-certs\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.484591 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.484586    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-workload-socket\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.485157 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.484662    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-data\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.485157 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.484810    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-credential-socket\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.485275 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.485256    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istiod-ca-cert\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.486495 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.486463    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-envoy\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.486721 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.486704    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-podinfo\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.493375 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.493348    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-token\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.493515 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.493482    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m7xt\" (UniqueName: \"kubernetes.io/projected/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-kube-api-access-6m7xt\") pod \"e2e-noten-6c22f6-openshift-default-596b468bbb-572bs\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") " pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.531684 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.531648    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:41.814010 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.813984    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"]
Sep 10 15:31:41.815780 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:31:41.815751    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd496ce0b_4ae6_4484_80d3_19f4f34dc5c4.slice/crio-372ba0729f397d70965bc54d85e1e8928364636c5bc81ec69c87f0427696f551 WatchSource:0}: Error finding container 372ba0729f397d70965bc54d85e1e8928364636c5bc81ec69c87f0427696f551: Status 404 returned error can't find the container with id 372ba0729f397d70965bc54d85e1e8928364636c5bc81ec69c87f0427696f551
Sep 10 15:31:41.817982 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.817913    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:31:41.818076 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.818022    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:31:41.818076 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:41.818054    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:31:42.686760 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:42.686713    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs" event={"ID":"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4","Type":"ContainerStarted","Data":"90d64ffe956afabd403764d1449ca294ae04ed83841448dc5ac0680471216336"}
Sep 10 15:31:42.687257 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:42.686777    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs" event={"ID":"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4","Type":"ContainerStarted","Data":"372ba0729f397d70965bc54d85e1e8928364636c5bc81ec69c87f0427696f551"}
Sep 10 15:31:42.709528 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:42.709477    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs" podStartSLOduration=1.709460713 podStartE2EDuration="1.709460713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:31:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:31:42.707514283 +0000 UTC m=+955.757312817" watchObservedRunningTime="2026-09-10 15:31:42.709460713 +0000 UTC m=+955.759259220"
Sep 10 15:31:43.532022 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:43.531976    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:43.534225 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:43.534188    2574 patch_prober.go:28] interesting pod/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 15:31:43.534391 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:43.534275    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8" podUID="a450b043-716b-4336-a82a-da8caa34b3de" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 15:31:43.537317 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:43.537297    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:43.693057 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:43.693023    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:43.694044 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:43.694020    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:31:45.707800 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.707759    2574 generic.go:356] "Generic (PLEG): container finished" podID="a450b043-716b-4336-a82a-da8caa34b3de" containerID="df56aab244b38e1e29f5e37e928cc660efd71f613672b7da3a5be4b19bb6e3f6" exitCode=0
Sep 10 15:31:45.708294 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.707828    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8" event={"ID":"a450b043-716b-4336-a82a-da8caa34b3de","Type":"ContainerDied","Data":"df56aab244b38e1e29f5e37e928cc660efd71f613672b7da3a5be4b19bb6e3f6"}
Sep 10 15:31:45.708294 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.707886    2574 scope.go:117] "RemoveContainer" containerID="f75ada97dee02212614cd1b255b5d43b0acf69c8add5e547e0ecf68adc7178f8"
Sep 10 15:31:45.742787 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.742727    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:31:45.932577 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.932542    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-credential-socket\") pod \"a450b043-716b-4336-a82a-da8caa34b3de\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") "
Sep 10 15:31:45.932577 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.932586    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqvs6\" (UniqueName: \"kubernetes.io/projected/a450b043-716b-4336-a82a-da8caa34b3de-kube-api-access-lqvs6\") pod \"a450b043-716b-4336-a82a-da8caa34b3de\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") "
Sep 10 15:31:45.932826 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.932616    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-istio-data\") pod \"a450b043-716b-4336-a82a-da8caa34b3de\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") "
Sep 10 15:31:45.932826 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.932646    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-workload-certs\") pod \"a450b043-716b-4336-a82a-da8caa34b3de\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") "
Sep 10 15:31:45.932826 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.932664    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a450b043-716b-4336-a82a-da8caa34b3de-istio-token\") pod \"a450b043-716b-4336-a82a-da8caa34b3de\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") "
Sep 10 15:31:45.932826 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.932691    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-workload-socket\") pod \"a450b043-716b-4336-a82a-da8caa34b3de\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") "
Sep 10 15:31:45.932826 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.932711    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a450b043-716b-4336-a82a-da8caa34b3de-istio-podinfo\") pod \"a450b043-716b-4336-a82a-da8caa34b3de\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") "
Sep 10 15:31:45.932826 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.932733    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a450b043-716b-4336-a82a-da8caa34b3de-istiod-ca-cert\") pod \"a450b043-716b-4336-a82a-da8caa34b3de\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") "
Sep 10 15:31:45.932826 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.932790    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-istio-envoy\") pod \"a450b043-716b-4336-a82a-da8caa34b3de\" (UID: \"a450b043-716b-4336-a82a-da8caa34b3de\") "
Sep 10 15:31:45.933208 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.932866    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a450b043-716b-4336-a82a-da8caa34b3de" (UID: "a450b043-716b-4336-a82a-da8caa34b3de"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:31:45.933208 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.933061    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a450b043-716b-4336-a82a-da8caa34b3de" (UID: "a450b043-716b-4336-a82a-da8caa34b3de"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:31:45.933208 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.933070    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-istio-data" (OuterVolumeSpecName: "istio-data") pod "a450b043-716b-4336-a82a-da8caa34b3de" (UID: "a450b043-716b-4336-a82a-da8caa34b3de"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:31:45.933208 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.933207    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-credential-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:31:45.933381 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.933234    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-istio-data\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:31:45.933381 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.933254    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-workload-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:31:45.933381 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.933200    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a450b043-716b-4336-a82a-da8caa34b3de" (UID: "a450b043-716b-4336-a82a-da8caa34b3de"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:31:45.933381 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.933300    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a450b043-716b-4336-a82a-da8caa34b3de-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a450b043-716b-4336-a82a-da8caa34b3de" (UID: "a450b043-716b-4336-a82a-da8caa34b3de"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:31:45.935047 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.935012    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a450b043-716b-4336-a82a-da8caa34b3de-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a450b043-716b-4336-a82a-da8caa34b3de" (UID: "a450b043-716b-4336-a82a-da8caa34b3de"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:31:45.935159 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.935056    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a450b043-716b-4336-a82a-da8caa34b3de" (UID: "a450b043-716b-4336-a82a-da8caa34b3de"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:31:45.935294 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.935273    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a450b043-716b-4336-a82a-da8caa34b3de-kube-api-access-lqvs6" (OuterVolumeSpecName: "kube-api-access-lqvs6") pod "a450b043-716b-4336-a82a-da8caa34b3de" (UID: "a450b043-716b-4336-a82a-da8caa34b3de"). InnerVolumeSpecName "kube-api-access-lqvs6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:31:45.935366 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:45.935350    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a450b043-716b-4336-a82a-da8caa34b3de-istio-token" (OuterVolumeSpecName: "istio-token") pod "a450b043-716b-4336-a82a-da8caa34b3de" (UID: "a450b043-716b-4336-a82a-da8caa34b3de"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:31:46.034513 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:46.034405    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqvs6\" (UniqueName: \"kubernetes.io/projected/a450b043-716b-4336-a82a-da8caa34b3de-kube-api-access-lqvs6\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:31:46.034513 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:46.034453    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a450b043-716b-4336-a82a-da8caa34b3de-istio-token\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:31:46.034513 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:46.034464    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-workload-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:31:46.034513 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:46.034472    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a450b043-716b-4336-a82a-da8caa34b3de-istio-podinfo\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:31:46.034513 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:46.034480    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a450b043-716b-4336-a82a-da8caa34b3de-istiod-ca-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:31:46.034513 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:46.034488    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a450b043-716b-4336-a82a-da8caa34b3de-istio-envoy\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:31:46.714538 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:46.714506    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"
Sep 10 15:31:46.714989 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:46.714542    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8" event={"ID":"a450b043-716b-4336-a82a-da8caa34b3de","Type":"ContainerDied","Data":"13350429b14aa3a6016a15815f648813c02cda4b0d06e2e5274b21a69e5bc4bf"}
Sep 10 15:31:46.714989 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:46.714598    2574 scope.go:117] "RemoveContainer" containerID="df56aab244b38e1e29f5e37e928cc660efd71f613672b7da3a5be4b19bb6e3f6"
Sep 10 15:31:46.740409 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:46.740368    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"]
Sep 10 15:31:46.747530 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:46.747499    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-57c78a-openshift-default-7595b7c476-7smk8"]
Sep 10 15:31:47.416058 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:47.416022    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a450b043-716b-4336-a82a-da8caa34b3de" path="/var/lib/kubelet/pods/a450b043-716b-4336-a82a-da8caa34b3de/volumes"
Sep 10 15:31:49.253365 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.253330    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"]
Sep 10 15:31:49.253860 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.253702    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a450b043-716b-4336-a82a-da8caa34b3de" containerName="istio-proxy"
Sep 10 15:31:49.253860 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.253713    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a450b043-716b-4336-a82a-da8caa34b3de" containerName="istio-proxy"
Sep 10 15:31:49.253860 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.253721    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a450b043-716b-4336-a82a-da8caa34b3de" containerName="istio-proxy"
Sep 10 15:31:49.253860 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.253726    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a450b043-716b-4336-a82a-da8caa34b3de" containerName="istio-proxy"
Sep 10 15:31:49.253860 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.253809    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a450b043-716b-4336-a82a-da8caa34b3de" containerName="istio-proxy"
Sep 10 15:31:49.253860 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.253817    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a450b043-716b-4336-a82a-da8caa34b3de" containerName="istio-proxy"
Sep 10 15:31:49.258394 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.258369    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.261427 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.261406    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-83557387-openshift-default-dockercfg-7fwv8\""
Sep 10 15:31:49.271882 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.271857    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"]
Sep 10 15:31:49.365707 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.365666    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-envoy\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.365905 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.365721    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c127949-a4c1-483e-acd3-f99f74a139a0-istiod-ca-cert\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.365905 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.365775    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-workload-socket\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.365905 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.365864    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khxls\" (UniqueName: \"kubernetes.io/projected/9c127949-a4c1-483e-acd3-f99f74a139a0-kube-api-access-khxls\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.365905 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.365901    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-data\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.366153 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.365963    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-workload-certs\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.366153 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.366011    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-token\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.366153 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.366050    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-credential-socket\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.366153 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.366075    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-podinfo\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.467258 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.467218    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khxls\" (UniqueName: \"kubernetes.io/projected/9c127949-a4c1-483e-acd3-f99f74a139a0-kube-api-access-khxls\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.467470 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.467278    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-data\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.467470 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.467327    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-workload-certs\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.467470 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.467358    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-token\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.467470 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.467393    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-credential-socket\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.467470 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.467420    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-podinfo\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.467742 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.467490    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-envoy\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.467742 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.467523    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c127949-a4c1-483e-acd3-f99f74a139a0-istiod-ca-cert\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.467742 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.467625    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-workload-socket\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.467903 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.467785    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-workload-certs\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.467903 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.467800    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-credential-socket\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.467903 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.467864    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-data\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.468046 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.468007    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-workload-socket\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.468316 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.468293    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c127949-a4c1-483e-acd3-f99f74a139a0-istiod-ca-cert\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.469980 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.469949    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-envoy\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.470173 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.470157    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-podinfo\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.476141 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.476121    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khxls\" (UniqueName: \"kubernetes.io/projected/9c127949-a4c1-483e-acd3-f99f74a139a0-kube-api-access-khxls\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.476243 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.476224    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-token\") pod \"e2e-mt-83557387-openshift-default-7b86549d8d-468hr\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") " pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.568883 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.568850    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:49.847198 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.847176    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"]
Sep 10 15:31:49.849385 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:31:49.849357    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c127949_a4c1_483e_acd3_f99f74a139a0.slice/crio-bd1eba47cf4583c82b9fc6677e2e5f2781ea27c6245ad18df1e2a54fb156f81b WatchSource:0}: Error finding container bd1eba47cf4583c82b9fc6677e2e5f2781ea27c6245ad18df1e2a54fb156f81b: Status 404 returned error can't find the container with id bd1eba47cf4583c82b9fc6677e2e5f2781ea27c6245ad18df1e2a54fb156f81b
Sep 10 15:31:49.852159 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.852128    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:31:49.852245 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.852189    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:31:49.852245 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:49.852218    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:31:50.739402 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:50.739364    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr" event={"ID":"9c127949-a4c1-483e-acd3-f99f74a139a0","Type":"ContainerStarted","Data":"cac84aa2855aad9be791da2f70047329751dae2d444f3213b99dabaacfcc369f"}
Sep 10 15:31:50.739811 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:50.739446    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr" event={"ID":"9c127949-a4c1-483e-acd3-f99f74a139a0","Type":"ContainerStarted","Data":"bd1eba47cf4583c82b9fc6677e2e5f2781ea27c6245ad18df1e2a54fb156f81b"}
Sep 10 15:31:50.764489 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:50.764429    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr" podStartSLOduration=1.764412892 podStartE2EDuration="1.764412892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:31:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:31:50.762410488 +0000 UTC m=+963.812208996" watchObservedRunningTime="2026-09-10 15:31:50.764412892 +0000 UTC m=+963.814211469"
Sep 10 15:31:51.569700 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:51.569664    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:51.574679 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:51.574654    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:51.745344 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:51.745310    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:31:51.746329 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:31:51.746307    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:32:11.892906 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:11.892867    2574 generic.go:356] "Generic (PLEG): container finished" podID="9c127949-a4c1-483e-acd3-f99f74a139a0" containerID="cac84aa2855aad9be791da2f70047329751dae2d444f3213b99dabaacfcc369f" exitCode=0
Sep 10 15:32:11.893408 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:11.892965    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr" event={"ID":"9c127949-a4c1-483e-acd3-f99f74a139a0","Type":"ContainerDied","Data":"cac84aa2855aad9be791da2f70047329751dae2d444f3213b99dabaacfcc369f"}
Sep 10 15:32:11.893531 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:11.893514    2574 scope.go:117] "RemoveContainer" containerID="cac84aa2855aad9be791da2f70047329751dae2d444f3213b99dabaacfcc369f"
Sep 10 15:32:11.894650 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:11.894624    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:32:11.894767 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:11.894705    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:32:11.894835 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:11.894760    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:32:12.900724 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:12.900693    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr" event={"ID":"9c127949-a4c1-483e-acd3-f99f74a139a0","Type":"ContainerStarted","Data":"5a4954b889c0fe9cdd5b1b95e9d31669d9b9adaad91a491c552758c640cd36fb"}
Sep 10 15:32:13.569781 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:13.569736    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:32:13.570107 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:13.570078    2574 patch_prober.go:28] interesting pod/e2e-mt-83557387-openshift-default-7b86549d8d-468hr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 10 15:32:13.570190 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:13.570164    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr" podUID="9c127949-a4c1-483e-acd3-f99f74a139a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 10 15:32:14.569772 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:14.569731    2574 patch_prober.go:28] interesting pod/e2e-mt-83557387-openshift-default-7b86549d8d-468hr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 10 15:32:14.570204 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:14.569803    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr" podUID="9c127949-a4c1-483e-acd3-f99f74a139a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 10 15:32:15.569457 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:15.569427    2574 patch_prober.go:28] interesting pod/e2e-mt-83557387-openshift-default-7b86549d8d-468hr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 10 15:32:15.569619 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:15.569482    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr" podUID="9c127949-a4c1-483e-acd3-f99f74a139a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 10 15:32:16.569805 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:16.569766    2574 patch_prober.go:28] interesting pod/e2e-mt-83557387-openshift-default-7b86549d8d-468hr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 10 15:32:16.570265 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:16.569827    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr" podUID="9c127949-a4c1-483e-acd3-f99f74a139a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 10 15:32:17.569500 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:17.569464    2574 patch_prober.go:28] interesting pod/e2e-mt-83557387-openshift-default-7b86549d8d-468hr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 10 15:32:17.569687 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:17.569538    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr" podUID="9c127949-a4c1-483e-acd3-f99f74a139a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 10 15:32:18.573636 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:18.573606    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:32:18.574098 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:18.574034    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:32:18.574719 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:18.574702    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:32:23.029164 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:23.029126    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-229c42-6mfgn"]
Sep 10 15:32:23.032988 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:23.032971    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-229c42-6mfgn"
Sep 10 15:32:23.035810 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:23.035789    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 15:32:23.035899 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:23.035876    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zzl2g\""
Sep 10 15:32:23.042828 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:23.042797    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-229c42-6mfgn"]
Sep 10 15:32:23.119365 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:23.119321    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e23b6347-ad54-41c9-a111-13200ea781d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-229c42-6mfgn\" (UID: \"e23b6347-ad54-41c9-a111-13200ea781d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-229c42-6mfgn"
Sep 10 15:32:23.220166 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:23.220130    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e23b6347-ad54-41c9-a111-13200ea781d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-229c42-6mfgn\" (UID: \"e23b6347-ad54-41c9-a111-13200ea781d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-229c42-6mfgn"
Sep 10 15:32:23.220795 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:23.220770    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e23b6347-ad54-41c9-a111-13200ea781d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-229c42-6mfgn\" (UID: \"e23b6347-ad54-41c9-a111-13200ea781d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-229c42-6mfgn"
Sep 10 15:32:23.345573 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:23.345532    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-229c42-6mfgn"
Sep 10 15:32:23.621188 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:23.621158    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-229c42-6mfgn"]
Sep 10 15:32:23.622431 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:32:23.622405    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode23b6347_ad54_41c9_a111_13200ea781d9.slice/crio-870bbc8db1c4d829f26bd5c6a3f41e446e470ad9346c4c17ecec88df7f7e24e6 WatchSource:0}: Error finding container 870bbc8db1c4d829f26bd5c6a3f41e446e470ad9346c4c17ecec88df7f7e24e6: Status 404 returned error can't find the container with id 870bbc8db1c4d829f26bd5c6a3f41e446e470ad9346c4c17ecec88df7f7e24e6
Sep 10 15:32:23.966712 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:23.966612    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-229c42-6mfgn" event={"ID":"e23b6347-ad54-41c9-a111-13200ea781d9","Type":"ContainerStarted","Data":"62da0f86c7efd91e14e18fa3230dabec83c97780bb0f34b7f5c34e20ab130310"}
Sep 10 15:32:23.966712 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:23.966696    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-229c42-6mfgn" event={"ID":"e23b6347-ad54-41c9-a111-13200ea781d9","Type":"ContainerStarted","Data":"870bbc8db1c4d829f26bd5c6a3f41e446e470ad9346c4c17ecec88df7f7e24e6"}
Sep 10 15:32:23.986177 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:23.986123    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-229c42-6mfgn" podStartSLOduration=0.986109502 podStartE2EDuration="986.109502ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:32:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:32:23.983035419 +0000 UTC m=+997.032833940" watchObservedRunningTime="2026-09-10 15:32:23.986109502 +0000 UTC m=+997.035908010"
Sep 10 15:32:24.145567 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:24.145522    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"]
Sep 10 15:32:24.146036 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:24.145810    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs" podUID="d496ce0b-4ae6-4484-80d3-19f4f34dc5c4" containerName="istio-proxy" containerID="cri-o://90d64ffe956afabd403764d1449ca294ae04ed83841448dc5ac0680471216336" gracePeriod=30
Sep 10 15:32:24.973481 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:24.973446    2574 generic.go:356] "Generic (PLEG): container finished" podID="e23b6347-ad54-41c9-a111-13200ea781d9" containerID="62da0f86c7efd91e14e18fa3230dabec83c97780bb0f34b7f5c34e20ab130310" exitCode=0
Sep 10 15:32:24.973675 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:24.973501    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-229c42-6mfgn" event={"ID":"e23b6347-ad54-41c9-a111-13200ea781d9","Type":"ContainerDied","Data":"62da0f86c7efd91e14e18fa3230dabec83c97780bb0f34b7f5c34e20ab130310"}
Sep 10 15:32:26.118610 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:26.118583    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-229c42-6mfgn"
Sep 10 15:32:26.148695 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:26.148664    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e23b6347-ad54-41c9-a111-13200ea781d9-maas-api-service-ca\") pod \"e23b6347-ad54-41c9-a111-13200ea781d9\" (UID: \"e23b6347-ad54-41c9-a111-13200ea781d9\") "
Sep 10 15:32:26.149102 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:26.149077    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e23b6347-ad54-41c9-a111-13200ea781d9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e23b6347-ad54-41c9-a111-13200ea781d9" (UID: "e23b6347-ad54-41c9-a111-13200ea781d9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:32:26.250518 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:26.250427    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e23b6347-ad54-41c9-a111-13200ea781d9-maas-api-service-ca\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:26.988299 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:26.988270    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-229c42-6mfgn"
Sep 10 15:32:26.988471 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:26.988272    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-229c42-6mfgn" event={"ID":"e23b6347-ad54-41c9-a111-13200ea781d9","Type":"ContainerDied","Data":"870bbc8db1c4d829f26bd5c6a3f41e446e470ad9346c4c17ecec88df7f7e24e6"}
Sep 10 15:32:26.988471 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:26.988397    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="870bbc8db1c4d829f26bd5c6a3f41e446e470ad9346c4c17ecec88df7f7e24e6"
Sep 10 15:32:28.695275 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:28.695239    2574 patch_prober.go:28] interesting pod/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 15:32:28.695645 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:28.695297    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs" podUID="d496ce0b-4ae6-4484-80d3-19f4f34dc5c4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 15:32:29.403649 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.403623    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:32:29.482378 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.482285    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-workload-certs\") pod \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") "
Sep 10 15:32:29.482378 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.482326    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-token\") pod \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") "
Sep 10 15:32:29.482569 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.482385    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-credential-socket\") pod \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") "
Sep 10 15:32:29.482569 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.482423    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-podinfo\") pod \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") "
Sep 10 15:32:29.482569 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.482464    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m7xt\" (UniqueName: \"kubernetes.io/projected/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-kube-api-access-6m7xt\") pod \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") "
Sep 10 15:32:29.482569 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.482514    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-envoy\") pod \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") "
Sep 10 15:32:29.482569 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.482548    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istiod-ca-cert\") pod \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") "
Sep 10 15:32:29.482826 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.482590    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-workload-socket\") pod \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") "
Sep 10 15:32:29.482826 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.482614    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-data\") pod \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\" (UID: \"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4\") "
Sep 10 15:32:29.482826 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.482632    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d496ce0b-4ae6-4484-80d3-19f4f34dc5c4" (UID: "d496ce0b-4ae6-4484-80d3-19f4f34dc5c4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:32:29.482826 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.482752    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d496ce0b-4ae6-4484-80d3-19f4f34dc5c4" (UID: "d496ce0b-4ae6-4484-80d3-19f4f34dc5c4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:32:29.483081 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.482866    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d496ce0b-4ae6-4484-80d3-19f4f34dc5c4" (UID: "d496ce0b-4ae6-4484-80d3-19f4f34dc5c4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:32:29.483081 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.482969    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-data" (OuterVolumeSpecName: "istio-data") pod "d496ce0b-4ae6-4484-80d3-19f4f34dc5c4" (UID: "d496ce0b-4ae6-4484-80d3-19f4f34dc5c4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:32:29.483081 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.482989    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d496ce0b-4ae6-4484-80d3-19f4f34dc5c4" (UID: "d496ce0b-4ae6-4484-80d3-19f4f34dc5c4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:32:29.483234 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.483112    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-credential-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:29.483234 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.483131    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istiod-ca-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:29.483234 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.483145    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-workload-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:29.483234 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.483157    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-data\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:29.483234 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.483170    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-workload-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:29.484770 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.484740    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d496ce0b-4ae6-4484-80d3-19f4f34dc5c4" (UID: "d496ce0b-4ae6-4484-80d3-19f4f34dc5c4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:32:29.484877 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.484833    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d496ce0b-4ae6-4484-80d3-19f4f34dc5c4" (UID: "d496ce0b-4ae6-4484-80d3-19f4f34dc5c4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:32:29.485146 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.485125    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-kube-api-access-6m7xt" (OuterVolumeSpecName: "kube-api-access-6m7xt") pod "d496ce0b-4ae6-4484-80d3-19f4f34dc5c4" (UID: "d496ce0b-4ae6-4484-80d3-19f4f34dc5c4"). InnerVolumeSpecName "kube-api-access-6m7xt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:32:29.485146 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.485136    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-token" (OuterVolumeSpecName: "istio-token") pod "d496ce0b-4ae6-4484-80d3-19f4f34dc5c4" (UID: "d496ce0b-4ae6-4484-80d3-19f4f34dc5c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:32:29.584591 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.584556    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-podinfo\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:29.584591 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.584584    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m7xt\" (UniqueName: \"kubernetes.io/projected/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-kube-api-access-6m7xt\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:29.584591 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.584595    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-envoy\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:29.584829 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:29.584603    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4-istio-token\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:30.009068 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:30.009031    2574 generic.go:356] "Generic (PLEG): container finished" podID="d496ce0b-4ae6-4484-80d3-19f4f34dc5c4" containerID="90d64ffe956afabd403764d1449ca294ae04ed83841448dc5ac0680471216336" exitCode=0
Sep 10 15:32:30.009458 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:30.009095    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"
Sep 10 15:32:30.009458 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:30.009116    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs" event={"ID":"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4","Type":"ContainerDied","Data":"90d64ffe956afabd403764d1449ca294ae04ed83841448dc5ac0680471216336"}
Sep 10 15:32:30.009458 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:30.009198    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs" event={"ID":"d496ce0b-4ae6-4484-80d3-19f4f34dc5c4","Type":"ContainerDied","Data":"372ba0729f397d70965bc54d85e1e8928364636c5bc81ec69c87f0427696f551"}
Sep 10 15:32:30.009458 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:30.009221    2574 scope.go:117] "RemoveContainer" containerID="90d64ffe956afabd403764d1449ca294ae04ed83841448dc5ac0680471216336"
Sep 10 15:32:30.019558 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:30.019541    2574 scope.go:117] "RemoveContainer" containerID="90d64ffe956afabd403764d1449ca294ae04ed83841448dc5ac0680471216336"
Sep 10 15:32:30.019851 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:32:30.019830    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90d64ffe956afabd403764d1449ca294ae04ed83841448dc5ac0680471216336\": container with ID starting with 90d64ffe956afabd403764d1449ca294ae04ed83841448dc5ac0680471216336 not found: ID does not exist" containerID="90d64ffe956afabd403764d1449ca294ae04ed83841448dc5ac0680471216336"
Sep 10 15:32:30.019899 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:30.019859    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90d64ffe956afabd403764d1449ca294ae04ed83841448dc5ac0680471216336"} err="failed to get container status \"90d64ffe956afabd403764d1449ca294ae04ed83841448dc5ac0680471216336\": rpc error: code = NotFound desc = could not find container \"90d64ffe956afabd403764d1449ca294ae04ed83841448dc5ac0680471216336\": container with ID starting with 90d64ffe956afabd403764d1449ca294ae04ed83841448dc5ac0680471216336 not found: ID does not exist"
Sep 10 15:32:30.034330 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:30.034302    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"]
Sep 10 15:32:30.038634 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:30.038587    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-6c22f6-openshift-default-596b468bbb-572bs"]
Sep 10 15:32:31.409507 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:31.409461    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d496ce0b-4ae6-4484-80d3-19f4f34dc5c4" path="/var/lib/kubelet/pods/d496ce0b-4ae6-4484-80d3-19f4f34dc5c4/volumes"
Sep 10 15:32:34.072467 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:34.072429    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-229c42-6mfgn"]
Sep 10 15:32:34.074801 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:34.074778    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-229c42-6mfgn"]
Sep 10 15:32:35.409429 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:35.409392    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e23b6347-ad54-41c9-a111-13200ea781d9" path="/var/lib/kubelet/pods/e23b6347-ad54-41c9-a111-13200ea781d9/volumes"
Sep 10 15:32:40.988604 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:40.988566    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"]
Sep 10 15:32:40.989201 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:40.988846    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn" podUID="ee9fd498-cc64-44be-8c15-59583e6796cb" containerName="istio-proxy" containerID="cri-o://e7fe845a5c80994f46729a87c35d19e08ee5cb433c81f6a4d48f6b95a9402daa" gracePeriod=30
Sep 10 15:32:41.338423 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:41.338388    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-50fe56-9pq8h"]
Sep 10 15:32:41.338781 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:41.338769    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e23b6347-ad54-41c9-a111-13200ea781d9" containerName="revoke-keys"
Sep 10 15:32:41.338834 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:41.338784    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e23b6347-ad54-41c9-a111-13200ea781d9" containerName="revoke-keys"
Sep 10 15:32:41.338834 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:41.338792    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d496ce0b-4ae6-4484-80d3-19f4f34dc5c4" containerName="istio-proxy"
Sep 10 15:32:41.338834 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:41.338797    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d496ce0b-4ae6-4484-80d3-19f4f34dc5c4" containerName="istio-proxy"
Sep 10 15:32:41.338975 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:41.338863    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d496ce0b-4ae6-4484-80d3-19f4f34dc5c4" containerName="istio-proxy"
Sep 10 15:32:41.338975 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:41.338872    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e23b6347-ad54-41c9-a111-13200ea781d9" containerName="revoke-keys"
Sep 10 15:32:41.343770 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:41.343752    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-50fe56-9pq8h"
Sep 10 15:32:41.346575 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:41.346551    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zzl2g\""
Sep 10 15:32:41.346575 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:41.346552    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 15:32:41.351094 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:41.351061    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-50fe56-9pq8h"]
Sep 10 15:32:41.398258 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:41.398214    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4585dd68-5f95-4416-ab14-d558ee778fab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-50fe56-9pq8h\" (UID: \"4585dd68-5f95-4416-ab14-d558ee778fab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-50fe56-9pq8h"
Sep 10 15:32:41.499630 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:41.499591    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4585dd68-5f95-4416-ab14-d558ee778fab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-50fe56-9pq8h\" (UID: \"4585dd68-5f95-4416-ab14-d558ee778fab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-50fe56-9pq8h"
Sep 10 15:32:41.500312 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:41.500284    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4585dd68-5f95-4416-ab14-d558ee778fab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-50fe56-9pq8h\" (UID: \"4585dd68-5f95-4416-ab14-d558ee778fab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-50fe56-9pq8h"
Sep 10 15:32:41.656540 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:41.656446    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-50fe56-9pq8h"
Sep 10 15:32:41.929947 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:41.929905    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-50fe56-9pq8h"]
Sep 10 15:32:41.931458 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:32:41.931434    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4585dd68_5f95_4416_ab14_d558ee778fab.slice/crio-df53525c496a174655853c2fda5a6779b2815d84497326e663c93531b6de7ca8 WatchSource:0}: Error finding container df53525c496a174655853c2fda5a6779b2815d84497326e663c93531b6de7ca8: Status 404 returned error can't find the container with id df53525c496a174655853c2fda5a6779b2815d84497326e663c93531b6de7ca8
Sep 10 15:32:42.095726 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:42.095689    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-50fe56-9pq8h" event={"ID":"4585dd68-5f95-4416-ab14-d558ee778fab","Type":"ContainerStarted","Data":"df53525c496a174655853c2fda5a6779b2815d84497326e663c93531b6de7ca8"}
Sep 10 15:32:43.015152 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:43.015063    2574 patch_prober.go:28] interesting pod/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 15:32:43.015152 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:43.015127    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn" podUID="ee9fd498-cc64-44be-8c15-59583e6796cb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 15:32:43.102894 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:43.102859    2574 generic.go:356] "Generic (PLEG): container finished" podID="4585dd68-5f95-4416-ab14-d558ee778fab" containerID="8e305fc8d73448272b4f209755505b88f0eae317012fbddf13cd2e9194d2ad08" exitCode=0
Sep 10 15:32:43.103292 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:43.102968    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-50fe56-9pq8h" event={"ID":"4585dd68-5f95-4416-ab14-d558ee778fab","Type":"ContainerDied","Data":"8e305fc8d73448272b4f209755505b88f0eae317012fbddf13cd2e9194d2ad08"}
Sep 10 15:32:43.821753 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:43.821722    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"]
Sep 10 15:32:43.821969 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:43.821947    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr" podUID="9c127949-a4c1-483e-acd3-f99f74a139a0" containerName="istio-proxy" containerID="cri-o://5a4954b889c0fe9cdd5b1b95e9d31669d9b9adaad91a491c552758c640cd36fb" gracePeriod=30
Sep 10 15:32:44.247664 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:44.247629    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-50fe56-9pq8h"
Sep 10 15:32:44.328992 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:44.328953    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4585dd68-5f95-4416-ab14-d558ee778fab-maas-api-service-ca\") pod \"4585dd68-5f95-4416-ab14-d558ee778fab\" (UID: \"4585dd68-5f95-4416-ab14-d558ee778fab\") "
Sep 10 15:32:44.329305 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:44.329284    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4585dd68-5f95-4416-ab14-d558ee778fab-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4585dd68-5f95-4416-ab14-d558ee778fab" (UID: "4585dd68-5f95-4416-ab14-d558ee778fab"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:32:44.430517 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:44.430426    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4585dd68-5f95-4416-ab14-d558ee778fab-maas-api-service-ca\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:45.115919 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:45.115882    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-50fe56-9pq8h" event={"ID":"4585dd68-5f95-4416-ab14-d558ee778fab","Type":"ContainerDied","Data":"df53525c496a174655853c2fda5a6779b2815d84497326e663c93531b6de7ca8"}
Sep 10 15:32:45.115919 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:45.115908    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-50fe56-9pq8h"
Sep 10 15:32:45.116161 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:45.115964    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df53525c496a174655853c2fda5a6779b2815d84497326e663c93531b6de7ca8"
Sep 10 15:32:46.124645 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.124611    2574 generic.go:356] "Generic (PLEG): container finished" podID="ee9fd498-cc64-44be-8c15-59583e6796cb" containerID="e7fe845a5c80994f46729a87c35d19e08ee5cb433c81f6a4d48f6b95a9402daa" exitCode=0
Sep 10 15:32:46.125118 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.124644    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn" event={"ID":"ee9fd498-cc64-44be-8c15-59583e6796cb","Type":"ContainerDied","Data":"e7fe845a5c80994f46729a87c35d19e08ee5cb433c81f6a4d48f6b95a9402daa"}
Sep 10 15:32:46.125118 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.124716    2574 scope.go:117] "RemoveContainer" containerID="36b9758ffa0f8bab0cfb681ad261af7b345ca546075bdbf5e751772b55262fe2"
Sep 10 15:32:46.245981 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.245948    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:32:46.349646 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.349604    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-token\") pod \"ee9fd498-cc64-44be-8c15-59583e6796cb\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") "
Sep 10 15:32:46.349646 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.349647    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-podinfo\") pod \"ee9fd498-cc64-44be-8c15-59583e6796cb\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") "
Sep 10 15:32:46.349873 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.349668    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee9fd498-cc64-44be-8c15-59583e6796cb-istiod-ca-cert\") pod \"ee9fd498-cc64-44be-8c15-59583e6796cb\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") "
Sep 10 15:32:46.349873 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.349700    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-workload-certs\") pod \"ee9fd498-cc64-44be-8c15-59583e6796cb\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") "
Sep 10 15:32:46.349873 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.349801    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-credential-socket\") pod \"ee9fd498-cc64-44be-8c15-59583e6796cb\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") "
Sep 10 15:32:46.349873 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.349854    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-workload-socket\") pod \"ee9fd498-cc64-44be-8c15-59583e6796cb\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") "
Sep 10 15:32:46.350106 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.349885    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-envoy\") pod \"ee9fd498-cc64-44be-8c15-59583e6796cb\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") "
Sep 10 15:32:46.350106 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.349950    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l89qd\" (UniqueName: \"kubernetes.io/projected/ee9fd498-cc64-44be-8c15-59583e6796cb-kube-api-access-l89qd\") pod \"ee9fd498-cc64-44be-8c15-59583e6796cb\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") "
Sep 10 15:32:46.350106 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.349984    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-data\") pod \"ee9fd498-cc64-44be-8c15-59583e6796cb\" (UID: \"ee9fd498-cc64-44be-8c15-59583e6796cb\") "
Sep 10 15:32:46.350106 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.349989    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee9fd498-cc64-44be-8c15-59583e6796cb" (UID: "ee9fd498-cc64-44be-8c15-59583e6796cb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:32:46.350347 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.350115    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee9fd498-cc64-44be-8c15-59583e6796cb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee9fd498-cc64-44be-8c15-59583e6796cb" (UID: "ee9fd498-cc64-44be-8c15-59583e6796cb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:32:46.350401 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.350334    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee9fd498-cc64-44be-8c15-59583e6796cb" (UID: "ee9fd498-cc64-44be-8c15-59583e6796cb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:32:46.350401 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.350380    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee9fd498-cc64-44be-8c15-59583e6796cb" (UID: "ee9fd498-cc64-44be-8c15-59583e6796cb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:32:46.350516 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.350419    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee9fd498-cc64-44be-8c15-59583e6796cb-istiod-ca-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:46.350516 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.350441    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-workload-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:46.350516 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.350440    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee9fd498-cc64-44be-8c15-59583e6796cb" (UID: "ee9fd498-cc64-44be-8c15-59583e6796cb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:32:46.352099 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.352074    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee9fd498-cc64-44be-8c15-59583e6796cb" (UID: "ee9fd498-cc64-44be-8c15-59583e6796cb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:32:46.352099 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.352088    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee9fd498-cc64-44be-8c15-59583e6796cb" (UID: "ee9fd498-cc64-44be-8c15-59583e6796cb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:32:46.352229 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.352197    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee9fd498-cc64-44be-8c15-59583e6796cb-kube-api-access-l89qd" (OuterVolumeSpecName: "kube-api-access-l89qd") pod "ee9fd498-cc64-44be-8c15-59583e6796cb" (UID: "ee9fd498-cc64-44be-8c15-59583e6796cb"). InnerVolumeSpecName "kube-api-access-l89qd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:32:46.352298 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.352279    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee9fd498-cc64-44be-8c15-59583e6796cb" (UID: "ee9fd498-cc64-44be-8c15-59583e6796cb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:32:46.451872 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.451835    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-token\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:46.451872 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.451867    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-podinfo\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:46.451872 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.451877    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-credential-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:46.452140 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.451887    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-workload-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:46.452140 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.451895    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-envoy\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:46.452140 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.451903    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l89qd\" (UniqueName: \"kubernetes.io/projected/ee9fd498-cc64-44be-8c15-59583e6796cb-kube-api-access-l89qd\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:46.452140 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:46.451911    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee9fd498-cc64-44be-8c15-59583e6796cb-istio-data\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:47.132261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:47.132228    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"
Sep 10 15:32:47.132261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:47.132255    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn" event={"ID":"ee9fd498-cc64-44be-8c15-59583e6796cb","Type":"ContainerDied","Data":"6eac97b41e60ddd9ab22c2b94b3213557b7b23a993856c4b7fe372ea22883fd9"}
Sep 10 15:32:47.132760 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:47.132310    2574 scope.go:117] "RemoveContainer" containerID="e7fe845a5c80994f46729a87c35d19e08ee5cb433c81f6a4d48f6b95a9402daa"
Sep 10 15:32:47.156979 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:47.156924    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"]
Sep 10 15:32:47.164633 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:47.164593    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-229c42-openshift-default-6b6d9694fd-25qgn"]
Sep 10 15:32:47.409352 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:47.409258    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee9fd498-cc64-44be-8c15-59583e6796cb" path="/var/lib/kubelet/pods/ee9fd498-cc64-44be-8c15-59583e6796cb/volumes"
Sep 10 15:32:48.575850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:48.575812    2574 patch_prober.go:28] interesting pod/e2e-mt-83557387-openshift-default-7b86549d8d-468hr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 15:32:48.576241 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:48.575869    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr" podUID="9c127949-a4c1-483e-acd3-f99f74a139a0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 15:32:49.088203 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.088137    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:32:49.147761 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.147727    2574 generic.go:356] "Generic (PLEG): container finished" podID="9c127949-a4c1-483e-acd3-f99f74a139a0" containerID="5a4954b889c0fe9cdd5b1b95e9d31669d9b9adaad91a491c552758c640cd36fb" exitCode=0
Sep 10 15:32:49.147954 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.147788    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"
Sep 10 15:32:49.147954 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.147824    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr" event={"ID":"9c127949-a4c1-483e-acd3-f99f74a139a0","Type":"ContainerDied","Data":"5a4954b889c0fe9cdd5b1b95e9d31669d9b9adaad91a491c552758c640cd36fb"}
Sep 10 15:32:49.147954 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.147903    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr" event={"ID":"9c127949-a4c1-483e-acd3-f99f74a139a0","Type":"ContainerDied","Data":"bd1eba47cf4583c82b9fc6677e2e5f2781ea27c6245ad18df1e2a54fb156f81b"}
Sep 10 15:32:49.147954 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.147950    2574 scope.go:117] "RemoveContainer" containerID="5a4954b889c0fe9cdd5b1b95e9d31669d9b9adaad91a491c552758c640cd36fb"
Sep 10 15:32:49.157169 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.157149    2574 scope.go:117] "RemoveContainer" containerID="cac84aa2855aad9be791da2f70047329751dae2d444f3213b99dabaacfcc369f"
Sep 10 15:32:49.165595 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.165575    2574 scope.go:117] "RemoveContainer" containerID="5a4954b889c0fe9cdd5b1b95e9d31669d9b9adaad91a491c552758c640cd36fb"
Sep 10 15:32:49.165881 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:32:49.165857    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a4954b889c0fe9cdd5b1b95e9d31669d9b9adaad91a491c552758c640cd36fb\": container with ID starting with 5a4954b889c0fe9cdd5b1b95e9d31669d9b9adaad91a491c552758c640cd36fb not found: ID does not exist" containerID="5a4954b889c0fe9cdd5b1b95e9d31669d9b9adaad91a491c552758c640cd36fb"
Sep 10 15:32:49.165966 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.165890    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a4954b889c0fe9cdd5b1b95e9d31669d9b9adaad91a491c552758c640cd36fb"} err="failed to get container status \"5a4954b889c0fe9cdd5b1b95e9d31669d9b9adaad91a491c552758c640cd36fb\": rpc error: code = NotFound desc = could not find container \"5a4954b889c0fe9cdd5b1b95e9d31669d9b9adaad91a491c552758c640cd36fb\": container with ID starting with 5a4954b889c0fe9cdd5b1b95e9d31669d9b9adaad91a491c552758c640cd36fb not found: ID does not exist"
Sep 10 15:32:49.165966 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.165910    2574 scope.go:117] "RemoveContainer" containerID="cac84aa2855aad9be791da2f70047329751dae2d444f3213b99dabaacfcc369f"
Sep 10 15:32:49.166206 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:32:49.166187    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cac84aa2855aad9be791da2f70047329751dae2d444f3213b99dabaacfcc369f\": container with ID starting with cac84aa2855aad9be791da2f70047329751dae2d444f3213b99dabaacfcc369f not found: ID does not exist" containerID="cac84aa2855aad9be791da2f70047329751dae2d444f3213b99dabaacfcc369f"
Sep 10 15:32:49.166245 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.166211    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cac84aa2855aad9be791da2f70047329751dae2d444f3213b99dabaacfcc369f"} err="failed to get container status \"cac84aa2855aad9be791da2f70047329751dae2d444f3213b99dabaacfcc369f\": rpc error: code = NotFound desc = could not find container \"cac84aa2855aad9be791da2f70047329751dae2d444f3213b99dabaacfcc369f\": container with ID starting with cac84aa2855aad9be791da2f70047329751dae2d444f3213b99dabaacfcc369f not found: ID does not exist"
Sep 10 15:32:49.179532 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.179509    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-data\") pod \"9c127949-a4c1-483e-acd3-f99f74a139a0\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") "
Sep 10 15:32:49.179614 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.179555    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-workload-socket\") pod \"9c127949-a4c1-483e-acd3-f99f74a139a0\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") "
Sep 10 15:32:49.179614 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.179573    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khxls\" (UniqueName: \"kubernetes.io/projected/9c127949-a4c1-483e-acd3-f99f74a139a0-kube-api-access-khxls\") pod \"9c127949-a4c1-483e-acd3-f99f74a139a0\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") "
Sep 10 15:32:49.179691 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.179635    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-credential-socket\") pod \"9c127949-a4c1-483e-acd3-f99f74a139a0\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") "
Sep 10 15:32:49.179691 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.179659    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-workload-certs\") pod \"9c127949-a4c1-483e-acd3-f99f74a139a0\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") "
Sep 10 15:32:49.179799 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.179715    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c127949-a4c1-483e-acd3-f99f74a139a0-istiod-ca-cert\") pod \"9c127949-a4c1-483e-acd3-f99f74a139a0\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") "
Sep 10 15:32:49.179799 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.179746    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-token\") pod \"9c127949-a4c1-483e-acd3-f99f74a139a0\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") "
Sep 10 15:32:49.179799 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.179760    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-data" (OuterVolumeSpecName: "istio-data") pod "9c127949-a4c1-483e-acd3-f99f74a139a0" (UID: "9c127949-a4c1-483e-acd3-f99f74a139a0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:32:49.179799 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.179774    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-podinfo\") pod \"9c127949-a4c1-483e-acd3-f99f74a139a0\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") "
Sep 10 15:32:49.179799 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.179787    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9c127949-a4c1-483e-acd3-f99f74a139a0" (UID: "9c127949-a4c1-483e-acd3-f99f74a139a0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:32:49.180083 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.179812    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-envoy\") pod \"9c127949-a4c1-483e-acd3-f99f74a139a0\" (UID: \"9c127949-a4c1-483e-acd3-f99f74a139a0\") "
Sep 10 15:32:49.180083 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.179957    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9c127949-a4c1-483e-acd3-f99f74a139a0" (UID: "9c127949-a4c1-483e-acd3-f99f74a139a0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:32:49.180083 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.180030    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9c127949-a4c1-483e-acd3-f99f74a139a0" (UID: "9c127949-a4c1-483e-acd3-f99f74a139a0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:32:49.180237 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.180131    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c127949-a4c1-483e-acd3-f99f74a139a0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9c127949-a4c1-483e-acd3-f99f74a139a0" (UID: "9c127949-a4c1-483e-acd3-f99f74a139a0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:32:49.180237 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.180153    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-data\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:49.180237 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.180168    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-workload-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:49.180237 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.180182    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-credential-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:49.180237 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.180195    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-workload-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:49.181772 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.181748    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c127949-a4c1-483e-acd3-f99f74a139a0-kube-api-access-khxls" (OuterVolumeSpecName: "kube-api-access-khxls") pod "9c127949-a4c1-483e-acd3-f99f74a139a0" (UID: "9c127949-a4c1-483e-acd3-f99f74a139a0"). InnerVolumeSpecName "kube-api-access-khxls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:32:49.181872 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.181828    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-token" (OuterVolumeSpecName: "istio-token") pod "9c127949-a4c1-483e-acd3-f99f74a139a0" (UID: "9c127949-a4c1-483e-acd3-f99f74a139a0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:32:49.181946 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.181912    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9c127949-a4c1-483e-acd3-f99f74a139a0" (UID: "9c127949-a4c1-483e-acd3-f99f74a139a0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:32:49.182076 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.182055    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9c127949-a4c1-483e-acd3-f99f74a139a0" (UID: "9c127949-a4c1-483e-acd3-f99f74a139a0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:32:49.281075 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.281037    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c127949-a4c1-483e-acd3-f99f74a139a0-istiod-ca-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:49.281075 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.281069    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-token\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:49.281075 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.281077    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-podinfo\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:49.281075 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.281084    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c127949-a4c1-483e-acd3-f99f74a139a0-istio-envoy\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:49.281349 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.281093    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khxls\" (UniqueName: \"kubernetes.io/projected/9c127949-a4c1-483e-acd3-f99f74a139a0-kube-api-access-khxls\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:32:49.466652 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.466615    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"]
Sep 10 15:32:49.470714 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:49.470686    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-83557387-openshift-default-7b86549d8d-468hr"]
Sep 10 15:32:51.408714 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:51.408677    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c127949-a4c1-483e-acd3-f99f74a139a0" path="/var/lib/kubelet/pods/9c127949-a4c1-483e-acd3-f99f74a139a0/volumes"
Sep 10 15:32:51.874105 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:51.874065    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-50fe56-29817570-rzkc9"]
Sep 10 15:32:51.876517 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:51.876495    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-50fe56-29817570-rzkc9"]
Sep 10 15:32:52.099651 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:52.099612    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-50fe56-9pq8h"]
Sep 10 15:32:52.102582 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:52.102555    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-50fe56-9pq8h"]
Sep 10 15:32:53.409815 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:53.409779    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4585dd68-5f95-4416-ab14-d558ee778fab" path="/var/lib/kubelet/pods/4585dd68-5f95-4416-ab14-d558ee778fab/volumes"
Sep 10 15:32:53.410210 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:53.410114    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a4c3b3f-e04c-4016-8b39-3a3ece5db0a5" path="/var/lib/kubelet/pods/9a4c3b3f-e04c-4016-8b39-3a3ece5db0a5/volumes"
Sep 10 15:32:58.143350 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.143318    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"]
Sep 10 15:32:58.143873 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.143852    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee9fd498-cc64-44be-8c15-59583e6796cb" containerName="istio-proxy"
Sep 10 15:32:58.143968 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.143876    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee9fd498-cc64-44be-8c15-59583e6796cb" containerName="istio-proxy"
Sep 10 15:32:58.143968 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.143895    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c127949-a4c1-483e-acd3-f99f74a139a0" containerName="istio-proxy"
Sep 10 15:32:58.143968 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.143902    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c127949-a4c1-483e-acd3-f99f74a139a0" containerName="istio-proxy"
Sep 10 15:32:58.143968 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.143916    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee9fd498-cc64-44be-8c15-59583e6796cb" containerName="istio-proxy"
Sep 10 15:32:58.143968 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.143940    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee9fd498-cc64-44be-8c15-59583e6796cb" containerName="istio-proxy"
Sep 10 15:32:58.143968 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.143952    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c127949-a4c1-483e-acd3-f99f74a139a0" containerName="istio-proxy"
Sep 10 15:32:58.143968 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.143960    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c127949-a4c1-483e-acd3-f99f74a139a0" containerName="istio-proxy"
Sep 10 15:32:58.144306 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.143990    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4585dd68-5f95-4416-ab14-d558ee778fab" containerName="revoke-keys"
Sep 10 15:32:58.144306 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.143999    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4585dd68-5f95-4416-ab14-d558ee778fab" containerName="revoke-keys"
Sep 10 15:32:58.144306 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.144090    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee9fd498-cc64-44be-8c15-59583e6796cb" containerName="istio-proxy"
Sep 10 15:32:58.144306 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.144102    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee9fd498-cc64-44be-8c15-59583e6796cb" containerName="istio-proxy"
Sep 10 15:32:58.144306 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.144112    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c127949-a4c1-483e-acd3-f99f74a139a0" containerName="istio-proxy"
Sep 10 15:32:58.144306 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.144125    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4585dd68-5f95-4416-ab14-d558ee778fab" containerName="revoke-keys"
Sep 10 15:32:58.144306 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.144134    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c127949-a4c1-483e-acd3-f99f74a139a0" containerName="istio-proxy"
Sep 10 15:32:58.148844 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.148823    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.151439 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.151414    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-5fe45b-openshift-default-dockercfg-4vc98\""
Sep 10 15:32:58.160355 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.160333    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"]
Sep 10 15:32:58.267821 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.267783    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-credential-socket\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.267821 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.267822    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-envoy\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.268122 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.267922    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istiod-ca-cert\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.268122 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.268023    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rws5z\" (UniqueName: \"kubernetes.io/projected/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-kube-api-access-rws5z\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.268122 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.268049    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-workload-certs\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.268122 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.268072    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-data\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.268122 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.268105    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-token\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.268345 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.268131    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-workload-socket\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.268345 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.268170    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-podinfo\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.369280 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.369238    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rws5z\" (UniqueName: \"kubernetes.io/projected/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-kube-api-access-rws5z\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.369485 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.369284    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-workload-certs\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.369485 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.369411    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-data\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.369485 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.369451    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-token\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.369485 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.369469    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-workload-socket\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.369711 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.369511    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-podinfo\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.369711 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.369589    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-credential-socket\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.369711 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.369625    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-envoy\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.369711 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.369693    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-workload-certs\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.369873 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.369719    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istiod-ca-cert\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.369873 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.369774    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-data\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.369873 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.369853    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-workload-socket\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.370057 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.370031    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-credential-socket\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.370370 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.370350    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istiod-ca-cert\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.371897 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.371874    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-envoy\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.372002 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.371977    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-podinfo\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.378769 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.378746    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-token\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.378991 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.378971    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rws5z\" (UniqueName: \"kubernetes.io/projected/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-kube-api-access-rws5z\") pod \"e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") " pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.460994 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.460870    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:58.743119 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.743092    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"]
Sep 10 15:32:58.743885 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:32:58.743859    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bfef2a1_12a1_4072_9a63_6b08b5bf7d0a.slice/crio-6e967bb1bec660cdbac48ce5f02f01ae4586334586a33a370cb6ee26f7a581d7 WatchSource:0}: Error finding container 6e967bb1bec660cdbac48ce5f02f01ae4586334586a33a370cb6ee26f7a581d7: Status 404 returned error can't find the container with id 6e967bb1bec660cdbac48ce5f02f01ae4586334586a33a370cb6ee26f7a581d7
Sep 10 15:32:58.746067 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.746037    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:32:58.746131 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.746098    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:32:58.746131 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:58.746125    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:32:59.226327 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:59.226284    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt" event={"ID":"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a","Type":"ContainerStarted","Data":"13c0f2bdc428ca70f4276252c4391e79b0878448412e32c6bd27fdf58e59b936"}
Sep 10 15:32:59.226738 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:59.226364    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt" event={"ID":"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a","Type":"ContainerStarted","Data":"6e967bb1bec660cdbac48ce5f02f01ae4586334586a33a370cb6ee26f7a581d7"}
Sep 10 15:32:59.253144 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:59.253086    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt" podStartSLOduration=1.253069169 podStartE2EDuration="1.253069169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:32:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:32:59.250834443 +0000 UTC m=+1032.300632953" watchObservedRunningTime="2026-09-10 15:32:59.253069169 +0000 UTC m=+1032.302867677"
Sep 10 15:32:59.284466 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:59.284426    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"]
Sep 10 15:32:59.284733 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:59.284707    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9" podUID="cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" containerName="istio-proxy" containerID="cri-o://e0663a07ccf76923e4bef5be5404ab6850451a98349d066d563908c1287dcc5f" gracePeriod=30
Sep 10 15:32:59.461474 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:59.461440    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:32:59.466432 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:32:59.466408    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:33:00.232873 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:00.232847    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:33:00.233731 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:00.233710    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:33:04.538424 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.538396    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:33:04.627423 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.627330    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istiod-ca-cert\") pod \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") "
Sep 10 15:33:04.627423 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.627366    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-token\") pod \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") "
Sep 10 15:33:04.627423 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.627396    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-workload-certs\") pod \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") "
Sep 10 15:33:04.627702 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.627462    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jcsh\" (UniqueName: \"kubernetes.io/projected/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-kube-api-access-2jcsh\") pod \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") "
Sep 10 15:33:04.627702 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.627518    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-workload-socket\") pod \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") "
Sep 10 15:33:04.627702 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.627560    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-envoy\") pod \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") "
Sep 10 15:33:04.627702 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.627591    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-data\") pod \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") "
Sep 10 15:33:04.627702 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.627618    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-credential-socket\") pod \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") "
Sep 10 15:33:04.627702 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.627647    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-podinfo\") pod \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\" (UID: \"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2\") "
Sep 10 15:33:04.628006 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.627715    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" (UID: "cd2e99b6-d9e1-41ec-9041-c797d9a4abb2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:33:04.628006 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.627737    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" (UID: "cd2e99b6-d9e1-41ec-9041-c797d9a4abb2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:33:04.628006 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.627828    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" (UID: "cd2e99b6-d9e1-41ec-9041-c797d9a4abb2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:33:04.628006 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.627882    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" (UID: "cd2e99b6-d9e1-41ec-9041-c797d9a4abb2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:33:04.628006 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.627983    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-data" (OuterVolumeSpecName: "istio-data") pod "cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" (UID: "cd2e99b6-d9e1-41ec-9041-c797d9a4abb2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:33:04.628282 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.628056    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-workload-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:33:04.628282 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.628075    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-credential-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:33:04.628282 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.628095    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istiod-ca-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:33:04.628282 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.628108    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-workload-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:33:04.629654 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.629627    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-token" (OuterVolumeSpecName: "istio-token") pod "cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" (UID: "cd2e99b6-d9e1-41ec-9041-c797d9a4abb2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:33:04.629761 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.629677    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-kube-api-access-2jcsh" (OuterVolumeSpecName: "kube-api-access-2jcsh") pod "cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" (UID: "cd2e99b6-d9e1-41ec-9041-c797d9a4abb2"). InnerVolumeSpecName "kube-api-access-2jcsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:33:04.629800 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.629762    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" (UID: "cd2e99b6-d9e1-41ec-9041-c797d9a4abb2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:33:04.629837 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.629824    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" (UID: "cd2e99b6-d9e1-41ec-9041-c797d9a4abb2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:33:04.729572 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.729534    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-token\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:33:04.729572 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.729566    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jcsh\" (UniqueName: \"kubernetes.io/projected/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-kube-api-access-2jcsh\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:33:04.729572 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.729578    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-envoy\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:33:04.729784 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.729588    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-data\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:33:04.729784 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:04.729595    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2-istio-podinfo\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:33:05.262989 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:05.262919    2574 generic.go:356] "Generic (PLEG): container finished" podID="cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" containerID="e0663a07ccf76923e4bef5be5404ab6850451a98349d066d563908c1287dcc5f" exitCode=0
Sep 10 15:33:05.262989 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:05.262975    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9" event={"ID":"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2","Type":"ContainerDied","Data":"e0663a07ccf76923e4bef5be5404ab6850451a98349d066d563908c1287dcc5f"}
Sep 10 15:33:05.263180 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:05.263009    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"
Sep 10 15:33:05.263180 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:05.263060    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9" event={"ID":"cd2e99b6-d9e1-41ec-9041-c797d9a4abb2","Type":"ContainerDied","Data":"bee63f98a2b8aaf84d23b55ba42073be06d1f69c99aa4c2d1b4c3400b3eeae69"}
Sep 10 15:33:05.263180 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:05.263084    2574 scope.go:117] "RemoveContainer" containerID="e0663a07ccf76923e4bef5be5404ab6850451a98349d066d563908c1287dcc5f"
Sep 10 15:33:05.272715 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:05.272701    2574 scope.go:117] "RemoveContainer" containerID="8c3a54745f5ad1abd7a53517a933bd29a72b1585c4e92a46d07f2e39ab6b14e8"
Sep 10 15:33:05.281440 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:05.281416    2574 scope.go:117] "RemoveContainer" containerID="e0663a07ccf76923e4bef5be5404ab6850451a98349d066d563908c1287dcc5f"
Sep 10 15:33:05.281731 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:33:05.281711    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0663a07ccf76923e4bef5be5404ab6850451a98349d066d563908c1287dcc5f\": container with ID starting with e0663a07ccf76923e4bef5be5404ab6850451a98349d066d563908c1287dcc5f not found: ID does not exist" containerID="e0663a07ccf76923e4bef5be5404ab6850451a98349d066d563908c1287dcc5f"
Sep 10 15:33:05.281785 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:05.281740    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0663a07ccf76923e4bef5be5404ab6850451a98349d066d563908c1287dcc5f"} err="failed to get container status \"e0663a07ccf76923e4bef5be5404ab6850451a98349d066d563908c1287dcc5f\": rpc error: code = NotFound desc = could not find container \"e0663a07ccf76923e4bef5be5404ab6850451a98349d066d563908c1287dcc5f\": container with ID starting with e0663a07ccf76923e4bef5be5404ab6850451a98349d066d563908c1287dcc5f not found: ID does not exist"
Sep 10 15:33:05.281785 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:05.281758    2574 scope.go:117] "RemoveContainer" containerID="8c3a54745f5ad1abd7a53517a933bd29a72b1585c4e92a46d07f2e39ab6b14e8"
Sep 10 15:33:05.282013 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:33:05.281995    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c3a54745f5ad1abd7a53517a933bd29a72b1585c4e92a46d07f2e39ab6b14e8\": container with ID starting with 8c3a54745f5ad1abd7a53517a933bd29a72b1585c4e92a46d07f2e39ab6b14e8 not found: ID does not exist" containerID="8c3a54745f5ad1abd7a53517a933bd29a72b1585c4e92a46d07f2e39ab6b14e8"
Sep 10 15:33:05.282054 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:05.282018    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c3a54745f5ad1abd7a53517a933bd29a72b1585c4e92a46d07f2e39ab6b14e8"} err="failed to get container status \"8c3a54745f5ad1abd7a53517a933bd29a72b1585c4e92a46d07f2e39ab6b14e8\": rpc error: code = NotFound desc = could not find container \"8c3a54745f5ad1abd7a53517a933bd29a72b1585c4e92a46d07f2e39ab6b14e8\": container with ID starting with 8c3a54745f5ad1abd7a53517a933bd29a72b1585c4e92a46d07f2e39ab6b14e8 not found: ID does not exist"
Sep 10 15:33:05.286426 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:05.286403    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"]
Sep 10 15:33:05.290500 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:05.290479    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-50fe56-openshift-default-55b58d8db-xntw9"]
Sep 10 15:33:05.409397 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:05.409365    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" path="/var/lib/kubelet/pods/cd2e99b6-d9e1-41ec-9041-c797d9a4abb2/volumes"
Sep 10 15:33:16.252423 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:16.252380    2574 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 15:33:16.252872 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:16.252469    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt" podUID="4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 15:33:16.334463 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:16.334432    2574 generic.go:356] "Generic (PLEG): container finished" podID="4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" containerID="13c0f2bdc428ca70f4276252c4391e79b0878448412e32c6bd27fdf58e59b936" exitCode=0
Sep 10 15:33:16.334628 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:16.334505    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt" event={"ID":"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a","Type":"ContainerDied","Data":"13c0f2bdc428ca70f4276252c4391e79b0878448412e32c6bd27fdf58e59b936"}
Sep 10 15:33:16.334949 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:16.334918    2574 scope.go:117] "RemoveContainer" containerID="13c0f2bdc428ca70f4276252c4391e79b0878448412e32c6bd27fdf58e59b936"
Sep 10 15:33:16.336086 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:16.336059    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:33:16.336193 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:16.336141    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:33:16.336270 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:16.336192    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:33:17.347302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:17.347254    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt" event={"ID":"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a","Type":"ContainerStarted","Data":"ebcac3088f4e463b20d92ae7cbfcfd3bc87f7da461486a18441abd2ac2406820"}
Sep 10 15:33:17.462120 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:17.462072    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:33:17.462328 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:17.462285    2574 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 15:33:17.462420 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:17.462355    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt" podUID="4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 15:33:18.461389 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:18.461350    2574 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 15:33:18.461780 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:18.461410    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt" podUID="4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 15:33:19.461590 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:19.461552    2574 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 15:33:19.461997 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:19.461613    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt" podUID="4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 15:33:20.462158 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:20.462123    2574 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 15:33:20.462591 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:20.462179    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt" podUID="4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 15:33:21.461680 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:21.461639    2574 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 15:33:21.461902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:21.461720    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt" podUID="4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 15:33:22.465235 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:22.465201    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:33:22.465741 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:22.465592    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:33:22.466270 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:22.466241    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:33:26.776426 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.776394    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"]
Sep 10 15:33:26.776823 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.776781    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" containerName="istio-proxy"
Sep 10 15:33:26.776823 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.776794    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" containerName="istio-proxy"
Sep 10 15:33:26.776919 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.776868    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" containerName="istio-proxy"
Sep 10 15:33:26.776919 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.776876    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" containerName="istio-proxy"
Sep 10 15:33:26.779156 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.779135    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.782067 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.782044    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-d7a2b3-openshift-default-dockercfg-9vg79\""
Sep 10 15:33:26.794054 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.794026    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"]
Sep 10 15:33:26.846458 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.846425    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phkvr\" (UniqueName: \"kubernetes.io/projected/b45c5ce1-75aa-48ce-95c3-3bb539f39964-kube-api-access-phkvr\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.846628 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.846469    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-podinfo\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.846628 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.846537    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-envoy\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.846628 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.846576    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-data\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.846628 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.846616    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-workload-socket\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.846771 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.846688    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istiod-ca-cert\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.846771 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.846710    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-token\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.846771 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.846740    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-credential-socket\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.846865 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.846800    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-workload-certs\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.947411 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.947368    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istiod-ca-cert\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.947411 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.947413    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-token\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.947666 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.947442    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-credential-socket\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.947666 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.947466    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-workload-certs\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.947666 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.947534    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phkvr\" (UniqueName: \"kubernetes.io/projected/b45c5ce1-75aa-48ce-95c3-3bb539f39964-kube-api-access-phkvr\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.947666 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.947576    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-podinfo\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.947666 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.947620    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-envoy\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.947968 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.947721    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-data\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.947968 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.947794    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-workload-socket\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.947968 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.947878    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-workload-certs\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.948150 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.948037    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-credential-socket\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.948209 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.948173    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-data\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.948209 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.948198    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-workload-socket\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.948296 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.948254    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istiod-ca-cert\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.949921 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.949886    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-envoy\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.950097 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.950080    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-podinfo\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.956249 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.956224    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-token\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:26.956351 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:26.956287    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phkvr\" (UniqueName: \"kubernetes.io/projected/b45c5ce1-75aa-48ce-95c3-3bb539f39964-kube-api-access-phkvr\") pod \"e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") " pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:27.089682 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:27.089642    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:27.370625 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:27.370404    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"]
Sep 10 15:33:27.373590 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:33:27.373557    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb45c5ce1_75aa_48ce_95c3_3bb539f39964.slice/crio-0f4dee313c9fc3c8a80bf1732c26231d115745b334fcbf144726f6adcb2606cf WatchSource:0}: Error finding container 0f4dee313c9fc3c8a80bf1732c26231d115745b334fcbf144726f6adcb2606cf: Status 404 returned error can't find the container with id 0f4dee313c9fc3c8a80bf1732c26231d115745b334fcbf144726f6adcb2606cf
Sep 10 15:33:27.376514 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:27.376480    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:33:27.376588 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:27.376547    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:33:27.376588 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:27.376575    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:33:27.419822 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:27.419789    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd" event={"ID":"b45c5ce1-75aa-48ce-95c3-3bb539f39964","Type":"ContainerStarted","Data":"0f4dee313c9fc3c8a80bf1732c26231d115745b334fcbf144726f6adcb2606cf"}
Sep 10 15:33:28.427250 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:28.427210    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd" event={"ID":"b45c5ce1-75aa-48ce-95c3-3bb539f39964","Type":"ContainerStarted","Data":"72c516b2dc397c0e4d707fe11580039b137048d759e3908410a1e4714e059a10"}
Sep 10 15:33:28.458916 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:28.458862    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd" podStartSLOduration=2.458847107 podStartE2EDuration="2.458847107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:33:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:28.457805444 +0000 UTC m=+1061.507603955" watchObservedRunningTime="2026-09-10 15:33:28.458847107 +0000 UTC m=+1061.508645615"
Sep 10 15:33:29.089820 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:29.089786    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:29.095017 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:29.094994    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:29.433622 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:29.433541    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:29.434427 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:29.434407    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:31.436570 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.436534    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"]
Sep 10 15:33:31.436950 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.436918    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" containerName="istio-proxy"
Sep 10 15:33:31.436950 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.436945    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd2e99b6-d9e1-41ec-9041-c797d9a4abb2" containerName="istio-proxy"
Sep 10 15:33:31.439186 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.439163    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.442537 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.442515    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-fc3e54-openshift-default-dockercfg-gkf2j\""
Sep 10 15:33:31.453808 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.453776    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"]
Sep 10 15:33:31.593519 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.593474    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-token\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.593519 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.593526    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-data\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.593759 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.593549    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istiod-ca-cert\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.593759 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.593606    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-workload-certs\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.593759 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.593640    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-workload-socket\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.593889 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.593780    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-podinfo\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.593889 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.593822    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-credential-socket\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.593889 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.593861    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-envoy\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.594042 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.593899    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9bc6\" (UniqueName: \"kubernetes.io/projected/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-kube-api-access-x9bc6\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.695549 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.695454    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-workload-certs\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.695549 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.695500    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-workload-socket\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.695781 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.695556    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-podinfo\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.695781 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.695587    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-credential-socket\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.695781 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.695621    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-envoy\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.695781 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.695650    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9bc6\" (UniqueName: \"kubernetes.io/projected/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-kube-api-access-x9bc6\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.695781 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.695727    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-token\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.695781 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.695768    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-data\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.696140 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.695796    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istiod-ca-cert\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.696140 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.695950    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-workload-certs\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.696140 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.695988    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-workload-socket\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.696140 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.696084    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-credential-socket\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.696453 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.696399    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-data\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.696559 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.696539    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istiod-ca-cert\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.698698 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.698677    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-podinfo\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.698698 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.698705    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-envoy\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.709436 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.709413    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9bc6\" (UniqueName: \"kubernetes.io/projected/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-kube-api-access-x9bc6\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.709618 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.709595    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-token\") pod \"e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") " pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:31.751684 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:31.751642    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:32.029688 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:32.029660    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"]
Sep 10 15:33:32.031384 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:33:32.031357    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f4bd0ed_10e1_416a_8ceb_d209b5a0035d.slice/crio-33708cb243666bdd58105e2776672d0aefef7cdee104031c492e69dbd015db9a WatchSource:0}: Error finding container 33708cb243666bdd58105e2776672d0aefef7cdee104031c492e69dbd015db9a: Status 404 returned error can't find the container with id 33708cb243666bdd58105e2776672d0aefef7cdee104031c492e69dbd015db9a
Sep 10 15:33:32.033608 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:32.033579    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:33:32.033677 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:32.033641    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:33:32.033677 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:32.033670    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:33:32.453334 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:32.453297    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk" event={"ID":"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d","Type":"ContainerStarted","Data":"29462e2d9fdb8b640cd2077766d9ab14eb07b27df5125804ed3d8472ad3a3619"}
Sep 10 15:33:32.453746 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:32.453348    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk" event={"ID":"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d","Type":"ContainerStarted","Data":"33708cb243666bdd58105e2776672d0aefef7cdee104031c492e69dbd015db9a"}
Sep 10 15:33:32.484264 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:32.479804    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk" podStartSLOduration=1.4797695530000001 podStartE2EDuration="1.479769553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:33:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:32.478403984 +0000 UTC m=+1065.528202490" watchObservedRunningTime="2026-09-10 15:33:32.479769553 +0000 UTC m=+1065.529568063"
Sep 10 15:33:32.752692 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:32.752605    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:33.757686 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:33.757655    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:34.464924 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:34.464891    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:34.465784 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:34.465765    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:45.488122 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:45.488073    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 15:33:45.488613 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:45.488149    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd" podUID="b45c5ce1-75aa-48ce-95c3-3bb539f39964" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 15:33:46.549530 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:46.549483    2574 generic.go:356] "Generic (PLEG): container finished" podID="b45c5ce1-75aa-48ce-95c3-3bb539f39964" containerID="72c516b2dc397c0e4d707fe11580039b137048d759e3908410a1e4714e059a10" exitCode=0
Sep 10 15:33:46.550129 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:46.549657    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd" event={"ID":"b45c5ce1-75aa-48ce-95c3-3bb539f39964","Type":"ContainerDied","Data":"72c516b2dc397c0e4d707fe11580039b137048d759e3908410a1e4714e059a10"}
Sep 10 15:33:46.550208 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:46.550186    2574 scope.go:117] "RemoveContainer" containerID="72c516b2dc397c0e4d707fe11580039b137048d759e3908410a1e4714e059a10"
Sep 10 15:33:46.551907 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:46.551864    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:33:46.552039 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:46.551978    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:33:46.552039 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:46.552030    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:33:47.557870 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:47.557830    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd" event={"ID":"b45c5ce1-75aa-48ce-95c3-3bb539f39964","Type":"ContainerStarted","Data":"f7890b6d117fc3c6dd69f2be6fb0174f68b8647db707d08f8a617ed2334d9adb"}
Sep 10 15:33:48.090493 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:48.090431    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:48.090715 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:48.090689    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 10 15:33:48.090791 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:48.090752    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd" podUID="b45c5ce1-75aa-48ce-95c3-3bb539f39964" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 10 15:33:49.090037 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:49.089995    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 10 15:33:49.090532 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:49.090057    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd" podUID="b45c5ce1-75aa-48ce-95c3-3bb539f39964" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 10 15:33:50.090100 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:50.090058    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 10 15:33:50.090488 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:50.090123    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd" podUID="b45c5ce1-75aa-48ce-95c3-3bb539f39964" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 10 15:33:50.507194 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:50.507092    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 15:33:50.507194 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:50.507160    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk" podUID="0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 15:33:51.090315 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:51.090274    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 10 15:33:51.090739 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:51.090336    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd" podUID="b45c5ce1-75aa-48ce-95c3-3bb539f39964" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 10 15:33:51.586692 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:51.586659    2574 generic.go:356] "Generic (PLEG): container finished" podID="0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" containerID="29462e2d9fdb8b640cd2077766d9ab14eb07b27df5125804ed3d8472ad3a3619" exitCode=0
Sep 10 15:33:51.586906 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:51.586732    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk" event={"ID":"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d","Type":"ContainerDied","Data":"29462e2d9fdb8b640cd2077766d9ab14eb07b27df5125804ed3d8472ad3a3619"}
Sep 10 15:33:51.587248 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:51.587216    2574 scope.go:117] "RemoveContainer" containerID="29462e2d9fdb8b640cd2077766d9ab14eb07b27df5125804ed3d8472ad3a3619"
Sep 10 15:33:51.588315 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:51.588285    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:33:51.588424 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:51.588351    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:33:51.588424 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:51.588385    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:33:52.090701 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:52.090657    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 10 15:33:52.091221 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:52.090720    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd" podUID="b45c5ce1-75aa-48ce-95c3-3bb539f39964" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 10 15:33:52.595009 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:52.594969    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk" event={"ID":"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d","Type":"ContainerStarted","Data":"46be5740774c80c821230801cc005e082cb0b3e160d8f38fe864b2922e8578b0"}
Sep 10 15:33:52.752193 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:52.752146    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:52.752411 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:52.752298    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 10 15:33:52.752411 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:52.752348    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk" podUID="0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 10 15:33:53.090295 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:53.090247    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 10 15:33:53.090443 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:53.090327    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd" podUID="b45c5ce1-75aa-48ce-95c3-3bb539f39964" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 10 15:33:53.752205 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:53.752162    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 10 15:33:53.752719 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:53.752227    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk" podUID="0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 10 15:33:54.094569 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:54.094538    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:54.094841 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:54.094821    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:54.095492 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:54.095471    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:33:54.752901 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:54.752843    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 10 15:33:54.753415 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:54.752923    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk" podUID="0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 10 15:33:55.752983 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:55.752852    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 10 15:33:55.752983 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:55.752922    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk" podUID="0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 10 15:33:56.044919 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:56.044876    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7821-178591"]
Sep 10 15:33:56.048342 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:56.048309    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7821-178591"
Sep 10 15:33:56.052630 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:56.052487    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7821-178591"]
Sep 10 15:33:56.052769 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:56.052635    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-h7f4v\""
Sep 10 15:33:56.154652 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:56.154612    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp58b\" (UniqueName: \"kubernetes.io/projected/f30f2c09-7701-465f-baeb-ab1fabe1cb67-kube-api-access-mp58b\") pod \"test-curl-7821-178591\" (UID: \"f30f2c09-7701-465f-baeb-ab1fabe1cb67\") " pod="opendatahub/test-curl-7821-178591"
Sep 10 15:33:56.256282 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:56.256241    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp58b\" (UniqueName: \"kubernetes.io/projected/f30f2c09-7701-465f-baeb-ab1fabe1cb67-kube-api-access-mp58b\") pod \"test-curl-7821-178591\" (UID: \"f30f2c09-7701-465f-baeb-ab1fabe1cb67\") " pod="opendatahub/test-curl-7821-178591"
Sep 10 15:33:56.265184 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:56.265151    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp58b\" (UniqueName: \"kubernetes.io/projected/f30f2c09-7701-465f-baeb-ab1fabe1cb67-kube-api-access-mp58b\") pod \"test-curl-7821-178591\" (UID: \"f30f2c09-7701-465f-baeb-ab1fabe1cb67\") " pod="opendatahub/test-curl-7821-178591"
Sep 10 15:33:56.362455 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:56.362362    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7821-178591"
Sep 10 15:33:56.641724 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:56.641625    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7821-178591"]
Sep 10 15:33:56.648868 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:33:56.648832    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf30f2c09_7701_465f_baeb_ab1fabe1cb67.slice/crio-947b732c24afa17a6c401c9a8422c5cf83e564bdec40b8b78cfa2700ceba5dfd WatchSource:0}: Error finding container 947b732c24afa17a6c401c9a8422c5cf83e564bdec40b8b78cfa2700ceba5dfd: Status 404 returned error can't find the container with id 947b732c24afa17a6c401c9a8422c5cf83e564bdec40b8b78cfa2700ceba5dfd
Sep 10 15:33:56.654546 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:56.652924    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 15:33:56.752979 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:56.752732    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 10 15:33:56.752979 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:56.752798    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk" podUID="0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 10 15:33:57.636201 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:57.636081    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7821-178591" event={"ID":"f30f2c09-7701-465f-baeb-ab1fabe1cb67","Type":"ContainerStarted","Data":"4b31ab1dfa59cb97273a3a4a4bc9c8f99ab6f0cd1aa61a65440396dc95c62fe8"}
Sep 10 15:33:57.636201 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:57.636153    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7821-178591" event={"ID":"f30f2c09-7701-465f-baeb-ab1fabe1cb67","Type":"ContainerStarted","Data":"947b732c24afa17a6c401c9a8422c5cf83e564bdec40b8b78cfa2700ceba5dfd"}
Sep 10 15:33:57.654703 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:57.654611    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7821-178591" podStartSLOduration=0.990456002 podStartE2EDuration="1.654592984s" totalImagesPullingTime="664.136982ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:33:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:57.654139433 +0000 UTC m=+1090.703937944" watchObservedRunningTime="2026-09-10 15:33:57.654592984 +0000 UTC m=+1090.704391506"
Sep 10 15:33:57.752613 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:57.752567    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 10 15:33:57.752816 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:57.752635    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk" podUID="0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 10 15:33:58.278488 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:58.278453    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7821-178591"]
Sep 10 15:33:58.283162 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:58.283138    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7821-178591"]
Sep 10 15:33:58.399311 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:58.399226    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7821-219e03"]
Sep 10 15:33:58.399631 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:58.399618    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f30f2c09-7701-465f-baeb-ab1fabe1cb67" containerName="test-curl-7821-178591"
Sep 10 15:33:58.399676 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:58.399632    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f30f2c09-7701-465f-baeb-ab1fabe1cb67" containerName="test-curl-7821-178591"
Sep 10 15:33:58.399712 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:58.399698    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f30f2c09-7701-465f-baeb-ab1fabe1cb67" containerName="test-curl-7821-178591"
Sep 10 15:33:58.401634 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:58.401616    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7821-219e03"
Sep 10 15:33:58.412164 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:58.412136    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7821-219e03"]
Sep 10 15:33:58.477679 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:58.477648    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct42g\" (UniqueName: \"kubernetes.io/projected/08b13854-646d-4f3e-adb7-a42c0d0fcd7b-kube-api-access-ct42g\") pod \"test-curl-7821-219e03\" (UID: \"08b13854-646d-4f3e-adb7-a42c0d0fcd7b\") " pod="opendatahub/test-curl-7821-219e03"
Sep 10 15:33:58.578474 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:58.578439    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct42g\" (UniqueName: \"kubernetes.io/projected/08b13854-646d-4f3e-adb7-a42c0d0fcd7b-kube-api-access-ct42g\") pod \"test-curl-7821-219e03\" (UID: \"08b13854-646d-4f3e-adb7-a42c0d0fcd7b\") " pod="opendatahub/test-curl-7821-219e03"
Sep 10 15:33:58.588318 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:58.588276    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct42g\" (UniqueName: \"kubernetes.io/projected/08b13854-646d-4f3e-adb7-a42c0d0fcd7b-kube-api-access-ct42g\") pod \"test-curl-7821-219e03\" (UID: \"08b13854-646d-4f3e-adb7-a42c0d0fcd7b\") " pod="opendatahub/test-curl-7821-219e03"
Sep 10 15:33:58.642395 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:33:58.642364    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7821-178591" container="test-curl-7821-178591"
Sep 10 15:33:58.711169 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:58.711084    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7821-219e03"
Sep 10 15:33:58.756950 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:58.756865    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:58.757306 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:58.757285    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:58.758858 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:58.758720    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:33:58.981775 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:58.981739    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7821-219e03"]
Sep 10 15:33:58.983218 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:33:58.983195    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08b13854_646d_4f3e_adb7_a42c0d0fcd7b.slice/crio-8391306f576cc7d2251b41f88d81f0eb3348db784a46d60cd1e44866eaabc0b5 WatchSource:0}: Error finding container 8391306f576cc7d2251b41f88d81f0eb3348db784a46d60cd1e44866eaabc0b5: Status 404 returned error can't find the container with id 8391306f576cc7d2251b41f88d81f0eb3348db784a46d60cd1e44866eaabc0b5
Sep 10 15:33:59.649034 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:59.648993    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7821-219e03" event={"ID":"08b13854-646d-4f3e-adb7-a42c0d0fcd7b","Type":"ContainerStarted","Data":"55526008c90a502ac2625496e69df02a3ee85aece6c2fa44255cf55c5ac5916b"}
Sep 10 15:33:59.649490 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:59.649047    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7821-219e03" event={"ID":"08b13854-646d-4f3e-adb7-a42c0d0fcd7b","Type":"ContainerStarted","Data":"8391306f576cc7d2251b41f88d81f0eb3348db784a46d60cd1e44866eaabc0b5"}
Sep 10 15:33:59.649490 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:59.649361    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7821-178591" podUID="f30f2c09-7701-465f-baeb-ab1fabe1cb67" containerName="test-curl-7821-178591" containerID="cri-o://4b31ab1dfa59cb97273a3a4a4bc9c8f99ab6f0cd1aa61a65440396dc95c62fe8" gracePeriod=2
Sep 10 15:33:59.671450 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:33:59.671382    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7821-219e03" podStartSLOduration=1.6713651170000001 podStartE2EDuration="1.671365117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:33:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:59.671101166 +0000 UTC m=+1092.720899674" watchObservedRunningTime="2026-09-10 15:33:59.671365117 +0000 UTC m=+1092.721163626"
Sep 10 15:34:00.275391 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:00.275355    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7821-219e03"]
Sep 10 15:34:00.280345 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:00.280313    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7821-219e03"]
Sep 10 15:34:00.655696 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:34:00.655666    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7821-219e03" container="test-curl-7821-219e03"
Sep 10 15:34:01.662798 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:01.662756    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7821-219e03" podUID="08b13854-646d-4f3e-adb7-a42c0d0fcd7b" containerName="test-curl-7821-219e03" containerID="cri-o://55526008c90a502ac2625496e69df02a3ee85aece6c2fa44255cf55c5ac5916b" gracePeriod=2
Sep 10 15:34:01.789682 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:01.789654    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7821-178591"
Sep 10 15:34:01.910087 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:01.909992    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mp58b\" (UniqueName: \"kubernetes.io/projected/f30f2c09-7701-465f-baeb-ab1fabe1cb67-kube-api-access-mp58b\") pod \"f30f2c09-7701-465f-baeb-ab1fabe1cb67\" (UID: \"f30f2c09-7701-465f-baeb-ab1fabe1cb67\") "
Sep 10 15:34:01.912227 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:01.912199    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f30f2c09-7701-465f-baeb-ab1fabe1cb67-kube-api-access-mp58b" (OuterVolumeSpecName: "kube-api-access-mp58b") pod "f30f2c09-7701-465f-baeb-ab1fabe1cb67" (UID: "f30f2c09-7701-465f-baeb-ab1fabe1cb67"). InnerVolumeSpecName "kube-api-access-mp58b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:34:02.011287 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:02.011251    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp58b\" (UniqueName: \"kubernetes.io/projected/f30f2c09-7701-465f-baeb-ab1fabe1cb67-kube-api-access-mp58b\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:34:02.079449 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:02.079406    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7821-474d0b"]
Sep 10 15:34:02.079847 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:02.079830    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08b13854-646d-4f3e-adb7-a42c0d0fcd7b" containerName="test-curl-7821-219e03"
Sep 10 15:34:02.079980 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:02.079851    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="08b13854-646d-4f3e-adb7-a42c0d0fcd7b" containerName="test-curl-7821-219e03"
Sep 10 15:34:02.080047 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:02.079991    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="08b13854-646d-4f3e-adb7-a42c0d0fcd7b" containerName="test-curl-7821-219e03"
Sep 10 15:34:02.081949 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:02.081917    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7821-474d0b"
Sep 10 15:34:02.089839 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:02.089815    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7821-474d0b"]
Sep 10 15:34:02.214037 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:02.213913    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqnfv\" (UniqueName: \"kubernetes.io/projected/57c9017c-9f2e-436b-be6f-c41d595e3dac-kube-api-access-jqnfv\") pod \"test-curl-7821-474d0b\" (UID: \"57c9017c-9f2e-436b-be6f-c41d595e3dac\") " pod="opendatahub/test-curl-7821-474d0b"
Sep 10 15:34:02.315352 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:02.315311    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqnfv\" (UniqueName: \"kubernetes.io/projected/57c9017c-9f2e-436b-be6f-c41d595e3dac-kube-api-access-jqnfv\") pod \"test-curl-7821-474d0b\" (UID: \"57c9017c-9f2e-436b-be6f-c41d595e3dac\") " pod="opendatahub/test-curl-7821-474d0b"
Sep 10 15:34:02.326555 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:02.326522    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqnfv\" (UniqueName: \"kubernetes.io/projected/57c9017c-9f2e-436b-be6f-c41d595e3dac-kube-api-access-jqnfv\") pod \"test-curl-7821-474d0b\" (UID: \"57c9017c-9f2e-436b-be6f-c41d595e3dac\") " pod="opendatahub/test-curl-7821-474d0b"
Sep 10 15:34:02.392298 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:02.392260    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7821-474d0b"
Sep 10 15:34:02.664118 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:02.664078    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7821-474d0b"]
Sep 10 15:34:02.664441 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:34:02.664231    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57c9017c_9f2e_436b_be6f_c41d595e3dac.slice/crio-f53cfb269a250e136dddeb434947fdcb8a062965f5ed1ee141f760178c867e24 WatchSource:0}: Error finding container f53cfb269a250e136dddeb434947fdcb8a062965f5ed1ee141f760178c867e24: Status 404 returned error can't find the container with id f53cfb269a250e136dddeb434947fdcb8a062965f5ed1ee141f760178c867e24
Sep 10 15:34:02.671301 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:02.671272    2574 generic.go:356] "Generic (PLEG): container finished" podID="f30f2c09-7701-465f-baeb-ab1fabe1cb67" containerID="4b31ab1dfa59cb97273a3a4a4bc9c8f99ab6f0cd1aa61a65440396dc95c62fe8" exitCode=137
Sep 10 15:34:02.671415 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:02.671353    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7821-178591"
Sep 10 15:34:02.671415 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:02.671404    2574 scope.go:117] "RemoveContainer" containerID="4b31ab1dfa59cb97273a3a4a4bc9c8f99ab6f0cd1aa61a65440396dc95c62fe8"
Sep 10 15:34:02.682137 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:02.682114    2574 scope.go:117] "RemoveContainer" containerID="4b31ab1dfa59cb97273a3a4a4bc9c8f99ab6f0cd1aa61a65440396dc95c62fe8"
Sep 10 15:34:02.682433 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:34:02.682412    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b31ab1dfa59cb97273a3a4a4bc9c8f99ab6f0cd1aa61a65440396dc95c62fe8\": container with ID starting with 4b31ab1dfa59cb97273a3a4a4bc9c8f99ab6f0cd1aa61a65440396dc95c62fe8 not found: ID does not exist" containerID="4b31ab1dfa59cb97273a3a4a4bc9c8f99ab6f0cd1aa61a65440396dc95c62fe8"
Sep 10 15:34:02.682482 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:02.682443    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b31ab1dfa59cb97273a3a4a4bc9c8f99ab6f0cd1aa61a65440396dc95c62fe8"} err="failed to get container status \"4b31ab1dfa59cb97273a3a4a4bc9c8f99ab6f0cd1aa61a65440396dc95c62fe8\": rpc error: code = NotFound desc = could not find container \"4b31ab1dfa59cb97273a3a4a4bc9c8f99ab6f0cd1aa61a65440396dc95c62fe8\": container with ID starting with 4b31ab1dfa59cb97273a3a4a4bc9c8f99ab6f0cd1aa61a65440396dc95c62fe8 not found: ID does not exist"
Sep 10 15:34:02.683143 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:34:02.683122    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7821-178591\" is forbidden: User \"system:node:ip-10-0-142-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-37.ec2.internal' and this object" podUID="f30f2c09-7701-465f-baeb-ab1fabe1cb67" pod="opendatahub/test-curl-7821-178591"
Sep 10 15:34:03.416413 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:03.416377    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f30f2c09-7701-465f-baeb-ab1fabe1cb67" path="/var/lib/kubelet/pods/f30f2c09-7701-465f-baeb-ab1fabe1cb67/volumes"
Sep 10 15:34:03.681178 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:03.681146    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7821-474d0b" event={"ID":"57c9017c-9f2e-436b-be6f-c41d595e3dac","Type":"ContainerStarted","Data":"5f55ad89dab4e96a9b9eca48b9032401f44a7e4d98b828a6e49cff5428a5c0b5"}
Sep 10 15:34:03.681492 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:03.681193    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7821-474d0b" event={"ID":"57c9017c-9f2e-436b-be6f-c41d595e3dac","Type":"ContainerStarted","Data":"f53cfb269a250e136dddeb434947fdcb8a062965f5ed1ee141f760178c867e24"}
Sep 10 15:34:03.700049 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:03.699996    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7821-474d0b" podStartSLOduration=1.699981078 podStartE2EDuration="1.699981078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:34:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:34:03.698792323 +0000 UTC m=+1096.748590833" watchObservedRunningTime="2026-09-10 15:34:03.699981078 +0000 UTC m=+1096.749779599"
Sep 10 15:34:03.837215 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:03.837189    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7821-219e03"
Sep 10 15:34:03.932240 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:03.932167    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct42g\" (UniqueName: \"kubernetes.io/projected/08b13854-646d-4f3e-adb7-a42c0d0fcd7b-kube-api-access-ct42g\") pod \"08b13854-646d-4f3e-adb7-a42c0d0fcd7b\" (UID: \"08b13854-646d-4f3e-adb7-a42c0d0fcd7b\") "
Sep 10 15:34:03.934318 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:03.934291    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08b13854-646d-4f3e-adb7-a42c0d0fcd7b-kube-api-access-ct42g" (OuterVolumeSpecName: "kube-api-access-ct42g") pod "08b13854-646d-4f3e-adb7-a42c0d0fcd7b" (UID: "08b13854-646d-4f3e-adb7-a42c0d0fcd7b"). InnerVolumeSpecName "kube-api-access-ct42g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:34:04.033910 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:04.033871    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct42g\" (UniqueName: \"kubernetes.io/projected/08b13854-646d-4f3e-adb7-a42c0d0fcd7b-kube-api-access-ct42g\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:34:04.318063 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:04.318026    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7821-474d0b"]
Sep 10 15:34:04.322668 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:04.322640    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7821-474d0b"]
Sep 10 15:34:04.690013 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:04.689900    2574 generic.go:356] "Generic (PLEG): container finished" podID="08b13854-646d-4f3e-adb7-a42c0d0fcd7b" containerID="55526008c90a502ac2625496e69df02a3ee85aece6c2fa44255cf55c5ac5916b" exitCode=137
Sep 10 15:34:04.690013 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:04.689964    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7821-219e03"
Sep 10 15:34:04.690013 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:04.690004    2574 scope.go:117] "RemoveContainer" containerID="55526008c90a502ac2625496e69df02a3ee85aece6c2fa44255cf55c5ac5916b"
Sep 10 15:34:04.690563 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:34:04.690301    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7821-474d0b" container="test-curl-7821-474d0b"
Sep 10 15:34:04.700388 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:04.700365    2574 scope.go:117] "RemoveContainer" containerID="55526008c90a502ac2625496e69df02a3ee85aece6c2fa44255cf55c5ac5916b"
Sep 10 15:34:04.700661 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:34:04.700644    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55526008c90a502ac2625496e69df02a3ee85aece6c2fa44255cf55c5ac5916b\": container with ID starting with 55526008c90a502ac2625496e69df02a3ee85aece6c2fa44255cf55c5ac5916b not found: ID does not exist" containerID="55526008c90a502ac2625496e69df02a3ee85aece6c2fa44255cf55c5ac5916b"
Sep 10 15:34:04.700736 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:04.700670    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55526008c90a502ac2625496e69df02a3ee85aece6c2fa44255cf55c5ac5916b"} err="failed to get container status \"55526008c90a502ac2625496e69df02a3ee85aece6c2fa44255cf55c5ac5916b\": rpc error: code = NotFound desc = could not find container \"55526008c90a502ac2625496e69df02a3ee85aece6c2fa44255cf55c5ac5916b\": container with ID starting with 55526008c90a502ac2625496e69df02a3ee85aece6c2fa44255cf55c5ac5916b not found: ID does not exist"
Sep 10 15:34:04.702274 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:34:04.702242    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7821-219e03\" is forbidden: User \"system:node:ip-10-0-142-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-37.ec2.internal' and this object" podUID="08b13854-646d-4f3e-adb7-a42c0d0fcd7b" pod="opendatahub/test-curl-7821-219e03"
Sep 10 15:34:05.270311 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.270273    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"]
Sep 10 15:34:05.270694 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.270680    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c9017c-9f2e-436b-be6f-c41d595e3dac" containerName="test-curl-7821-474d0b"
Sep 10 15:34:05.270735 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.270696    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c9017c-9f2e-436b-be6f-c41d595e3dac" containerName="test-curl-7821-474d0b"
Sep 10 15:34:05.270781 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.270771    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="57c9017c-9f2e-436b-be6f-c41d595e3dac" containerName="test-curl-7821-474d0b"
Sep 10 15:34:05.273536 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.273520    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.278042 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.278020    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-26935da7-openshift-default-dockercfg-r9bl6\""
Sep 10 15:34:05.313100 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.313071    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"]
Sep 10 15:34:05.346572 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.346529    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/950c4b19-abb6-4434-93b2-028cf362a379-istiod-ca-cert\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.346902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.346878    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/950c4b19-abb6-4434-93b2-028cf362a379-istio-token\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.347144 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.347127    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-istio-envoy\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.347331 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.347315    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-workload-certs\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.347541 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.347522    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8629l\" (UniqueName: \"kubernetes.io/projected/950c4b19-abb6-4434-93b2-028cf362a379-kube-api-access-8629l\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.347704 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.347689    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-workload-socket\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.347962 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.347916    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-credential-socket\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.348089 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.348075    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-istio-data\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.348261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.348246    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/950c4b19-abb6-4434-93b2-028cf362a379-istio-podinfo\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.369689 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:34:05.369641    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7821-219e03\" is forbidden: User \"system:node:ip-10-0-142-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-37.ec2.internal' and this object" podUID="08b13854-646d-4f3e-adb7-a42c0d0fcd7b" pod="opendatahub/test-curl-7821-219e03"
Sep 10 15:34:05.409910 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.409870    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08b13854-646d-4f3e-adb7-a42c0d0fcd7b" path="/var/lib/kubelet/pods/08b13854-646d-4f3e-adb7-a42c0d0fcd7b/volumes"
Sep 10 15:34:05.449604 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.449569    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-workload-certs\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.449803 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.449648    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8629l\" (UniqueName: \"kubernetes.io/projected/950c4b19-abb6-4434-93b2-028cf362a379-kube-api-access-8629l\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.449803 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.449679    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-workload-socket\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.449803 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.449709    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-credential-socket\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.449803 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.449735    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-istio-data\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.450069 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.449811    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/950c4b19-abb6-4434-93b2-028cf362a379-istio-podinfo\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.450069 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.450001    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/950c4b19-abb6-4434-93b2-028cf362a379-istiod-ca-cert\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.450194 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.450068    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/950c4b19-abb6-4434-93b2-028cf362a379-istio-token\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.450194 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.450083    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-workload-certs\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.450194 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.450136    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-credential-socket\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.450194 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.450156    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-istio-envoy\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.450376 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.450159    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-workload-socket\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.450414 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.450377    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-istio-data\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.450681 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.450659    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/950c4b19-abb6-4434-93b2-028cf362a379-istiod-ca-cert\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.452160 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.452140    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-istio-envoy\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.452292 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.452245    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/950c4b19-abb6-4434-93b2-028cf362a379-istio-podinfo\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.459260 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.459237    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8629l\" (UniqueName: \"kubernetes.io/projected/950c4b19-abb6-4434-93b2-028cf362a379-kube-api-access-8629l\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.459368 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.459290    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/950c4b19-abb6-4434-93b2-028cf362a379-istio-token\") pod \"e2e-mt-26935da7-openshift-default-86b594889b-829xw\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") " pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.583843 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.583809    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:05.697594 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.697558    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7821-474d0b" podUID="57c9017c-9f2e-436b-be6f-c41d595e3dac" containerName="test-curl-7821-474d0b" containerID="cri-o://5f55ad89dab4e96a9b9eca48b9032401f44a7e4d98b828a6e49cff5428a5c0b5" gracePeriod=2
Sep 10 15:34:05.870149 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.870124    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"]
Sep 10 15:34:05.872516 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:34:05.872487    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod950c4b19_abb6_4434_93b2_028cf362a379.slice/crio-a9497978ea19db2cdda23c8a23060d2857784baf20c84cd5dd37a0dc5c25c5d5 WatchSource:0}: Error finding container a9497978ea19db2cdda23c8a23060d2857784baf20c84cd5dd37a0dc5c25c5d5: Status 404 returned error can't find the container with id a9497978ea19db2cdda23c8a23060d2857784baf20c84cd5dd37a0dc5c25c5d5
Sep 10 15:34:05.874986 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.874922    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:34:05.875076 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.875034    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:34:05.875138 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:05.875078    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:34:06.705568 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:06.705528    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw" event={"ID":"950c4b19-abb6-4434-93b2-028cf362a379","Type":"ContainerStarted","Data":"09a903ba552d716b9771b5ca970ee126e667a1026d79dcd8ab904701226796c5"}
Sep 10 15:34:06.705972 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:06.705587    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw" event={"ID":"950c4b19-abb6-4434-93b2-028cf362a379","Type":"ContainerStarted","Data":"a9497978ea19db2cdda23c8a23060d2857784baf20c84cd5dd37a0dc5c25c5d5"}
Sep 10 15:34:06.732377 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:06.732324    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw" podStartSLOduration=1.732309357 podStartE2EDuration="1.732309357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:34:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:34:06.730594049 +0000 UTC m=+1099.780392553" watchObservedRunningTime="2026-09-10 15:34:06.732309357 +0000 UTC m=+1099.782107929"
Sep 10 15:34:07.584438 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:07.584402    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:07.589829 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:07.589803    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:07.711818 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:07.711788    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:07.712990 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:07.712969    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:07.847151 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:07.847089    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7821-474d0b"
Sep 10 15:34:07.976894 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:07.976858    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqnfv\" (UniqueName: \"kubernetes.io/projected/57c9017c-9f2e-436b-be6f-c41d595e3dac-kube-api-access-jqnfv\") pod \"57c9017c-9f2e-436b-be6f-c41d595e3dac\" (UID: \"57c9017c-9f2e-436b-be6f-c41d595e3dac\") "
Sep 10 15:34:07.979037 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:07.979006    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57c9017c-9f2e-436b-be6f-c41d595e3dac-kube-api-access-jqnfv" (OuterVolumeSpecName: "kube-api-access-jqnfv") pod "57c9017c-9f2e-436b-be6f-c41d595e3dac" (UID: "57c9017c-9f2e-436b-be6f-c41d595e3dac"). InnerVolumeSpecName "kube-api-access-jqnfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:34:08.078418 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.078381    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqnfv\" (UniqueName: \"kubernetes.io/projected/57c9017c-9f2e-436b-be6f-c41d595e3dac-kube-api-access-jqnfv\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:34:08.656912 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.656878    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"]
Sep 10 15:34:08.659309 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.659291    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:08.664021 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.664003    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-62d2f7\"/\"kube-root-ca.crt\""
Sep 10 15:34:08.665204 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.665180    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-62d2f7\"/\"default-dockercfg-mfpk6\""
Sep 10 15:34:08.665292 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.665203    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-62d2f7\"/\"auth-test-model-62d2f7-kserve-self-signed-certs\""
Sep 10 15:34:08.665292 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.665220    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-62d2f7\"/\"openshift-service-ca.crt\""
Sep 10 15:34:08.679242 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.679216    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"]
Sep 10 15:34:08.718799 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.718758    2574 generic.go:356] "Generic (PLEG): container finished" podID="57c9017c-9f2e-436b-be6f-c41d595e3dac" containerID="5f55ad89dab4e96a9b9eca48b9032401f44a7e4d98b828a6e49cff5428a5c0b5" exitCode=137
Sep 10 15:34:08.718799 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.718799    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7821-474d0b"
Sep 10 15:34:08.719306 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.718856    2574 scope.go:117] "RemoveContainer" containerID="5f55ad89dab4e96a9b9eca48b9032401f44a7e4d98b828a6e49cff5428a5c0b5"
Sep 10 15:34:08.728719 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.728702    2574 scope.go:117] "RemoveContainer" containerID="5f55ad89dab4e96a9b9eca48b9032401f44a7e4d98b828a6e49cff5428a5c0b5"
Sep 10 15:34:08.729029 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:34:08.729007    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f55ad89dab4e96a9b9eca48b9032401f44a7e4d98b828a6e49cff5428a5c0b5\": container with ID starting with 5f55ad89dab4e96a9b9eca48b9032401f44a7e4d98b828a6e49cff5428a5c0b5 not found: ID does not exist" containerID="5f55ad89dab4e96a9b9eca48b9032401f44a7e4d98b828a6e49cff5428a5c0b5"
Sep 10 15:34:08.729078 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.729044    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f55ad89dab4e96a9b9eca48b9032401f44a7e4d98b828a6e49cff5428a5c0b5"} err="failed to get container status \"5f55ad89dab4e96a9b9eca48b9032401f44a7e4d98b828a6e49cff5428a5c0b5\": rpc error: code = NotFound desc = could not find container \"5f55ad89dab4e96a9b9eca48b9032401f44a7e4d98b828a6e49cff5428a5c0b5\": container with ID starting with 5f55ad89dab4e96a9b9eca48b9032401f44a7e4d98b828a6e49cff5428a5c0b5 not found: ID does not exist"
Sep 10 15:34:08.729885 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:34:08.729862    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7821-474d0b\" is forbidden: User \"system:node:ip-10-0-142-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-37.ec2.internal' and this object" podUID="57c9017c-9f2e-436b-be6f-c41d595e3dac" pod="opendatahub/test-curl-7821-474d0b"
Sep 10 15:34:08.786186 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.786154    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-model-cache\") pod \"auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") " pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:08.786420 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.786393    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-tmp-dir\") pod \"auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") " pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:08.786606 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.786581    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfc40782-2bf3-4ed6-957e-48eb202892e4-tls-certs\") pod \"auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") " pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:08.786680 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.786666    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-dshm\") pod \"auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") " pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:08.786751 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.786732    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8x82\" (UniqueName: \"kubernetes.io/projected/bfc40782-2bf3-4ed6-957e-48eb202892e4-kube-api-access-c8x82\") pod \"auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") " pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:08.786804 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.786769    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-home\") pod \"auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") " pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:08.888230 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.888192    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8x82\" (UniqueName: \"kubernetes.io/projected/bfc40782-2bf3-4ed6-957e-48eb202892e4-kube-api-access-c8x82\") pod \"auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") " pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:08.888230 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.888232    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-home\") pod \"auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") " pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:08.888423 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.888313    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-model-cache\") pod \"auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") " pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:08.888423 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.888334    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-tmp-dir\") pod \"auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") " pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:08.888423 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.888378    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfc40782-2bf3-4ed6-957e-48eb202892e4-tls-certs\") pod \"auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") " pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:08.888423 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.888412    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-dshm\") pod \"auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") " pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:08.888684 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.888661    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-home\") pod \"auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") " pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:08.888756 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.888693    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-model-cache\") pod \"auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") " pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:08.888847 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.888817    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-tmp-dir\") pod \"auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") " pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:08.890704 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.890682    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-dshm\") pod \"auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") " pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:08.891261 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.891238    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfc40782-2bf3-4ed6-957e-48eb202892e4-tls-certs\") pod \"auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") " pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:08.904122 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.904083    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8x82\" (UniqueName: \"kubernetes.io/projected/bfc40782-2bf3-4ed6-957e-48eb202892e4-kube-api-access-c8x82\") pod \"auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") " pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:08.967999 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:08.967899    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:09.276013 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:09.275982    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"]
Sep 10 15:34:09.277520 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:34:09.277494    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfc40782_2bf3_4ed6_957e_48eb202892e4.slice/crio-2b1777e34d8699a219d467925363a1ea3a3bd6e89083983003eadf1ad429e9a4 WatchSource:0}: Error finding container 2b1777e34d8699a219d467925363a1ea3a3bd6e89083983003eadf1ad429e9a4: Status 404 returned error can't find the container with id 2b1777e34d8699a219d467925363a1ea3a3bd6e89083983003eadf1ad429e9a4
Sep 10 15:34:09.409848 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:09.409815    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57c9017c-9f2e-436b-be6f-c41d595e3dac" path="/var/lib/kubelet/pods/57c9017c-9f2e-436b-be6f-c41d595e3dac/volumes"
Sep 10 15:34:09.727794 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:09.727753    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9" event={"ID":"bfc40782-2bf3-4ed6-957e-48eb202892e4","Type":"ContainerStarted","Data":"85c8f96010794368cfc88358de310d7314335e1d254bc5604e0c96ba1fa25fbd"}
Sep 10 15:34:09.728291 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:09.727803    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9" event={"ID":"bfc40782-2bf3-4ed6-957e-48eb202892e4","Type":"ContainerStarted","Data":"2b1777e34d8699a219d467925363a1ea3a3bd6e89083983003eadf1ad429e9a4"}
Sep 10 15:34:09.763132 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:09.763081    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9" podStartSLOduration=1.763063507 podStartE2EDuration="1.763063507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:34:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:34:09.763038508 +0000 UTC m=+1102.812837015" watchObservedRunningTime="2026-09-10 15:34:09.763063507 +0000 UTC m=+1102.812862015"
Sep 10 15:34:18.968046 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:18.968006    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:18.968593 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:18.968117    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:18.980371 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:18.980349    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:19.798064 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:19.798031    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:34:28.842320 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:28.842279    2574 generic.go:356] "Generic (PLEG): container finished" podID="950c4b19-abb6-4434-93b2-028cf362a379" containerID="09a903ba552d716b9771b5ca970ee126e667a1026d79dcd8ab904701226796c5" exitCode=0
Sep 10 15:34:28.842744 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:28.842352    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw" event={"ID":"950c4b19-abb6-4434-93b2-028cf362a379","Type":"ContainerDied","Data":"09a903ba552d716b9771b5ca970ee126e667a1026d79dcd8ab904701226796c5"}
Sep 10 15:34:28.842787 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:28.842765    2574 scope.go:117] "RemoveContainer" containerID="09a903ba552d716b9771b5ca970ee126e667a1026d79dcd8ab904701226796c5"
Sep 10 15:34:28.843996 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:28.843971    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:34:28.844079 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:28.844036    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:34:28.844116 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:28.844075    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:34:29.855543 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:29.855503    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw" event={"ID":"950c4b19-abb6-4434-93b2-028cf362a379","Type":"ContainerStarted","Data":"ba326931f58e57594ee02ac6ad6d342e5bd649f32e7c80ba28b1d4052586b8be"}
Sep 10 15:34:30.584244 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:30.584208    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:30.584417 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:30.584373    2574 patch_prober.go:28] interesting pod/e2e-mt-26935da7-openshift-default-86b594889b-829xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 10 15:34:30.584467 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:30.584431    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw" podUID="950c4b19-abb6-4434-93b2-028cf362a379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 10 15:34:31.584718 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:31.584677    2574 patch_prober.go:28] interesting pod/e2e-mt-26935da7-openshift-default-86b594889b-829xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 10 15:34:31.585161 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:31.584739    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw" podUID="950c4b19-abb6-4434-93b2-028cf362a379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 10 15:34:32.584801 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:32.584765    2574 patch_prober.go:28] interesting pod/e2e-mt-26935da7-openshift-default-86b594889b-829xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 10 15:34:32.585247 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:32.584822    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw" podUID="950c4b19-abb6-4434-93b2-028cf362a379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 10 15:34:33.584195 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:33.584165    2574 patch_prober.go:28] interesting pod/e2e-mt-26935da7-openshift-default-86b594889b-829xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 10 15:34:33.584369 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:33.584215    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw" podUID="950c4b19-abb6-4434-93b2-028cf362a379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 10 15:34:34.585044 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:34.585004    2574 patch_prober.go:28] interesting pod/e2e-mt-26935da7-openshift-default-86b594889b-829xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 10 15:34:34.585461 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:34.585067    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw" podUID="950c4b19-abb6-4434-93b2-028cf362a379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 10 15:34:35.588752 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:35.588722    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:35.589162 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:35.589039    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:35.589778 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:35.589756    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:34:48.710842 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:34:48.710806    2574 scope.go:117] "RemoveContainer" containerID="10a544e95d0b4a51784a38bb0d8bb94d511a4f156169e5a76855b2963d21c13b"
Sep 10 15:35:47.445375 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:35:47.445344    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/2.log"
Sep 10 15:35:47.450388 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:35:47.450368    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/2.log"
Sep 10 15:35:48.745891 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:35:48.745855    2574 scope.go:117] "RemoveContainer" containerID="a68bb845ba34e04a6d53fbe36cd7d5187023aa2a6d04f96112abd633080b2802"
Sep 10 15:35:48.754981 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:35:48.754962    2574 scope.go:117] "RemoveContainer" containerID="b347ffba66474284f695bc17040449999dde75bffb437d3323621e3a5f636555"
Sep 10 15:35:48.763018 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:35:48.763000    2574 scope.go:117] "RemoveContainer" containerID="f4e9a1f82ca12b70b5dac84f9d12e537e37e85b5e4476564aa21070a5fec0afb"
Sep 10 15:35:59.057904 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:35:59.057872    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26935da7-7pzmp"]
Sep 10 15:35:59.062795 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:35:59.062775    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26935da7-7pzmp"
Sep 10 15:35:59.066168 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:35:59.066138    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 15:35:59.066319 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:35:59.066138    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zzl2g\""
Sep 10 15:35:59.071585 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:35:59.071554    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26935da7-7pzmp"]
Sep 10 15:35:59.223741 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:35:59.223703    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04afb072-5edd-4514-a1e5-2525336431c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-26935da7-7pzmp\" (UID: \"04afb072-5edd-4514-a1e5-2525336431c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26935da7-7pzmp"
Sep 10 15:35:59.325412 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:35:59.325320    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04afb072-5edd-4514-a1e5-2525336431c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-26935da7-7pzmp\" (UID: \"04afb072-5edd-4514-a1e5-2525336431c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26935da7-7pzmp"
Sep 10 15:35:59.326053 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:35:59.326026    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04afb072-5edd-4514-a1e5-2525336431c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-26935da7-7pzmp\" (UID: \"04afb072-5edd-4514-a1e5-2525336431c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26935da7-7pzmp"
Sep 10 15:35:59.375226 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:35:59.375174    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26935da7-7pzmp"
Sep 10 15:35:59.655408 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:35:59.655381    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26935da7-7pzmp"]
Sep 10 15:35:59.657164 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:35:59.657135    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04afb072_5edd_4514_a1e5_2525336431c8.slice/crio-c1a2ddf41a020d66f967eb5cec44b585f81233c1c7e28d54a3f33408fe9f52ea WatchSource:0}: Error finding container c1a2ddf41a020d66f967eb5cec44b585f81233c1c7e28d54a3f33408fe9f52ea: Status 404 returned error can't find the container with id c1a2ddf41a020d66f967eb5cec44b585f81233c1c7e28d54a3f33408fe9f52ea
Sep 10 15:36:00.416650 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:36:00.416610    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26935da7-7pzmp" event={"ID":"04afb072-5edd-4514-a1e5-2525336431c8","Type":"ContainerStarted","Data":"a53732f4067db6be35d264caae6f950e640d0f0321691c4bed7d7c3919eb412d"}
Sep 10 15:36:00.417097 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:36:00.416671    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26935da7-7pzmp" event={"ID":"04afb072-5edd-4514-a1e5-2525336431c8","Type":"ContainerStarted","Data":"c1a2ddf41a020d66f967eb5cec44b585f81233c1c7e28d54a3f33408fe9f52ea"}
Sep 10 15:36:00.439251 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:36:00.439198    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26935da7-7pzmp" podStartSLOduration=1.4391780889999999 podStartE2EDuration="1.439178089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:35:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:36:00.43382158 +0000 UTC m=+1213.483620089" watchObservedRunningTime="2026-09-10 15:36:00.439178089 +0000 UTC m=+1213.488976598"
Sep 10 15:36:01.424037 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:36:01.424002    2574 generic.go:356] "Generic (PLEG): container finished" podID="04afb072-5edd-4514-a1e5-2525336431c8" containerID="a53732f4067db6be35d264caae6f950e640d0f0321691c4bed7d7c3919eb412d" exitCode=0
Sep 10 15:36:01.424435 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:36:01.424067    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26935da7-7pzmp" event={"ID":"04afb072-5edd-4514-a1e5-2525336431c8","Type":"ContainerDied","Data":"a53732f4067db6be35d264caae6f950e640d0f0321691c4bed7d7c3919eb412d"}
Sep 10 15:36:02.566054 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:36:02.566026    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26935da7-7pzmp"
Sep 10 15:36:02.661605 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:36:02.661569    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04afb072-5edd-4514-a1e5-2525336431c8-maas-api-service-ca\") pod \"04afb072-5edd-4514-a1e5-2525336431c8\" (UID: \"04afb072-5edd-4514-a1e5-2525336431c8\") "
Sep 10 15:36:02.661975 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:36:02.661925    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04afb072-5edd-4514-a1e5-2525336431c8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "04afb072-5edd-4514-a1e5-2525336431c8" (UID: "04afb072-5edd-4514-a1e5-2525336431c8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:36:02.762994 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:36:02.762906    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04afb072-5edd-4514-a1e5-2525336431c8-maas-api-service-ca\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:36:03.437087 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:36:03.437055    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26935da7-7pzmp"
Sep 10 15:36:03.437087 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:36:03.437067    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26935da7-7pzmp" event={"ID":"04afb072-5edd-4514-a1e5-2525336431c8","Type":"ContainerDied","Data":"c1a2ddf41a020d66f967eb5cec44b585f81233c1c7e28d54a3f33408fe9f52ea"}
Sep 10 15:36:03.437315 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:36:03.437108    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1a2ddf41a020d66f967eb5cec44b585f81233c1c7e28d54a3f33408fe9f52ea"
Sep 10 15:36:14.782826 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:36:14.782791    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26935da7-7pzmp"]
Sep 10 15:36:14.785624 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:36:14.785594    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26935da7-7pzmp"]
Sep 10 15:36:15.409693 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:36:15.409659    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04afb072-5edd-4514-a1e5-2525336431c8" path="/var/lib/kubelet/pods/04afb072-5edd-4514-a1e5-2525336431c8/volumes"
Sep 10 15:36:48.802750 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:36:48.802669    2574 scope.go:117] "RemoveContainer" containerID="304d4c789a65cd39bfa92b9911b5e66a62fa992d11676232ae821b62195463f1"
Sep 10 15:36:48.811893 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:36:48.811875    2574 scope.go:117] "RemoveContainer" containerID="b953bde838d7351206980d1db9aa5b120a70cf2a5be734ac3738289ae8b539f1"
Sep 10 15:37:06.646335 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:06.646302    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"]
Sep 10 15:37:06.646753 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:06.646546    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw" podUID="950c4b19-abb6-4434-93b2-028cf362a379" containerName="istio-proxy" containerID="cri-o://ba326931f58e57594ee02ac6ad6d342e5bd649f32e7c80ba28b1d4052586b8be" gracePeriod=30
Sep 10 15:37:11.845802 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:11.845771    2574 generic.go:356] "Generic (PLEG): container finished" podID="950c4b19-abb6-4434-93b2-028cf362a379" containerID="ba326931f58e57594ee02ac6ad6d342e5bd649f32e7c80ba28b1d4052586b8be" exitCode=0
Sep 10 15:37:11.846192 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:11.845842    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw" event={"ID":"950c4b19-abb6-4434-93b2-028cf362a379","Type":"ContainerDied","Data":"ba326931f58e57594ee02ac6ad6d342e5bd649f32e7c80ba28b1d4052586b8be"}
Sep 10 15:37:11.846192 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:11.845906    2574 scope.go:117] "RemoveContainer" containerID="09a903ba552d716b9771b5ca970ee126e667a1026d79dcd8ab904701226796c5"
Sep 10 15:37:11.908216 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:11.908155    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:37:12.033477 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.033442    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-workload-certs\") pod \"950c4b19-abb6-4434-93b2-028cf362a379\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") "
Sep 10 15:37:12.033683 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.033491    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/950c4b19-abb6-4434-93b2-028cf362a379-istio-podinfo\") pod \"950c4b19-abb6-4434-93b2-028cf362a379\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") "
Sep 10 15:37:12.033683 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.033521    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/950c4b19-abb6-4434-93b2-028cf362a379-istiod-ca-cert\") pod \"950c4b19-abb6-4434-93b2-028cf362a379\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") "
Sep 10 15:37:12.033683 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.033546    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8629l\" (UniqueName: \"kubernetes.io/projected/950c4b19-abb6-4434-93b2-028cf362a379-kube-api-access-8629l\") pod \"950c4b19-abb6-4434-93b2-028cf362a379\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") "
Sep 10 15:37:12.033683 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.033579    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-credential-socket\") pod \"950c4b19-abb6-4434-93b2-028cf362a379\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") "
Sep 10 15:37:12.033683 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.033633    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-istio-data\") pod \"950c4b19-abb6-4434-93b2-028cf362a379\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") "
Sep 10 15:37:12.033683 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.033674    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/950c4b19-abb6-4434-93b2-028cf362a379-istio-token\") pod \"950c4b19-abb6-4434-93b2-028cf362a379\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") "
Sep 10 15:37:12.034037 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.033781    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "950c4b19-abb6-4434-93b2-028cf362a379" (UID: "950c4b19-abb6-4434-93b2-028cf362a379"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:37:12.034037 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.033801    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-workload-socket\") pod \"950c4b19-abb6-4434-93b2-028cf362a379\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") "
Sep 10 15:37:12.034037 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.033837    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-istio-envoy\") pod \"950c4b19-abb6-4434-93b2-028cf362a379\" (UID: \"950c4b19-abb6-4434-93b2-028cf362a379\") "
Sep 10 15:37:12.034037 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.033991    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "950c4b19-abb6-4434-93b2-028cf362a379" (UID: "950c4b19-abb6-4434-93b2-028cf362a379"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:37:12.034037 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.034006    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-istio-data" (OuterVolumeSpecName: "istio-data") pod "950c4b19-abb6-4434-93b2-028cf362a379" (UID: "950c4b19-abb6-4434-93b2-028cf362a379"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:37:12.034318 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.034132    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "950c4b19-abb6-4434-93b2-028cf362a379" (UID: "950c4b19-abb6-4434-93b2-028cf362a379"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:37:12.034318 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.034293    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-credential-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:37:12.034318 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.034309    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/950c4b19-abb6-4434-93b2-028cf362a379-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "950c4b19-abb6-4434-93b2-028cf362a379" (UID: "950c4b19-abb6-4434-93b2-028cf362a379"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:37:12.034486 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.034314    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-istio-data\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:37:12.034486 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.034339    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-workload-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:37:12.034486 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.034353    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-workload-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:37:12.035920 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.035894    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/950c4b19-abb6-4434-93b2-028cf362a379-kube-api-access-8629l" (OuterVolumeSpecName: "kube-api-access-8629l") pod "950c4b19-abb6-4434-93b2-028cf362a379" (UID: "950c4b19-abb6-4434-93b2-028cf362a379"). InnerVolumeSpecName "kube-api-access-8629l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:37:12.036140 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.036108    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "950c4b19-abb6-4434-93b2-028cf362a379" (UID: "950c4b19-abb6-4434-93b2-028cf362a379"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:37:12.036236 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.036173    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/950c4b19-abb6-4434-93b2-028cf362a379-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "950c4b19-abb6-4434-93b2-028cf362a379" (UID: "950c4b19-abb6-4434-93b2-028cf362a379"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:37:12.036236 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.036198    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/950c4b19-abb6-4434-93b2-028cf362a379-istio-token" (OuterVolumeSpecName: "istio-token") pod "950c4b19-abb6-4434-93b2-028cf362a379" (UID: "950c4b19-abb6-4434-93b2-028cf362a379"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:37:12.135093 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.135055    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/950c4b19-abb6-4434-93b2-028cf362a379-istio-token\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:37:12.135093 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.135086    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/950c4b19-abb6-4434-93b2-028cf362a379-istio-envoy\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:37:12.135093 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.135095    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/950c4b19-abb6-4434-93b2-028cf362a379-istio-podinfo\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:37:12.135093 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.135103    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/950c4b19-abb6-4434-93b2-028cf362a379-istiod-ca-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:37:12.135364 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.135111    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8629l\" (UniqueName: \"kubernetes.io/projected/950c4b19-abb6-4434-93b2-028cf362a379-kube-api-access-8629l\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:37:12.852802 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.852771    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"
Sep 10 15:37:12.853263 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.852807    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw" event={"ID":"950c4b19-abb6-4434-93b2-028cf362a379","Type":"ContainerDied","Data":"a9497978ea19db2cdda23c8a23060d2857784baf20c84cd5dd37a0dc5c25c5d5"}
Sep 10 15:37:12.853263 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.852860    2574 scope.go:117] "RemoveContainer" containerID="ba326931f58e57594ee02ac6ad6d342e5bd649f32e7c80ba28b1d4052586b8be"
Sep 10 15:37:12.880848 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.880822    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"]
Sep 10 15:37:12.885022 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:12.884992    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-26935da7-openshift-default-86b594889b-829xw"]
Sep 10 15:37:13.409511 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:13.409474    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="950c4b19-abb6-4434-93b2-028cf362a379" path="/var/lib/kubelet/pods/950c4b19-abb6-4434-93b2-028cf362a379/volumes"
Sep 10 15:37:48.841813 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:48.841780    2574 scope.go:117] "RemoveContainer" containerID="6812d8da93341a3fcb5539de44a7caff39783cea9cc046398f0179bef361c1b4"
Sep 10 15:37:54.494266 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:37:54.494231    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"]
Sep 10 15:38:02.301029 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.300990    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"]
Sep 10 15:38:02.301501 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.301365    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="950c4b19-abb6-4434-93b2-028cf362a379" containerName="istio-proxy"
Sep 10 15:38:02.301501 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.301377    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="950c4b19-abb6-4434-93b2-028cf362a379" containerName="istio-proxy"
Sep 10 15:38:02.301501 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.301403    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04afb072-5edd-4514-a1e5-2525336431c8" containerName="revoke-keys"
Sep 10 15:38:02.301501 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.301409    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="04afb072-5edd-4514-a1e5-2525336431c8" containerName="revoke-keys"
Sep 10 15:38:02.301501 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.301482    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="950c4b19-abb6-4434-93b2-028cf362a379" containerName="istio-proxy"
Sep 10 15:38:02.301501 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.301491    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="04afb072-5edd-4514-a1e5-2525336431c8" containerName="revoke-keys"
Sep 10 15:38:02.301501 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.301497    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="950c4b19-abb6-4434-93b2-028cf362a379" containerName="istio-proxy"
Sep 10 15:38:02.305917 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.305898    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.310278 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.310247    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-dd499d-openshift-default-dockercfg-xzmrz\""
Sep 10 15:38:02.325368 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.325345    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"]
Sep 10 15:38:02.439873 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.439828    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istiod-ca-cert\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.439873 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.439872    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-workload-socket\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.440104 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.439952    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-podinfo\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.440104 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.440014    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-credential-socket\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.440104 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.440051    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-data\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.440104 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.440100    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccjlv\" (UniqueName: \"kubernetes.io/projected/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-kube-api-access-ccjlv\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.440239 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.440133    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-envoy\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.440239 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.440156    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-token\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.440239 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.440204    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-workload-certs\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.541426 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.541390    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istiod-ca-cert\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.541426 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.541432    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-workload-socket\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.541652 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.541476    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-podinfo\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.541652 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.541512    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-credential-socket\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.541652 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.541569    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-data\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.541652 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.541630    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccjlv\" (UniqueName: \"kubernetes.io/projected/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-kube-api-access-ccjlv\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.541873 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.541667    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-envoy\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.541873 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.541703    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-token\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.541873 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.541842    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-workload-certs\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.542153 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.541872    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-workload-socket\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.542153 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.541895    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-credential-socket\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.542312 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.542291    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-data\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.542498 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.542478    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-workload-certs\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.542653 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.542628    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istiod-ca-cert\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.544210 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.544188    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-envoy\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.544311 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.544285    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-podinfo\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.550518 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.550499    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-token\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.551000 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.550983    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccjlv\" (UniqueName: \"kubernetes.io/projected/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-kube-api-access-ccjlv\") pod \"e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") " pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.616091 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.616007    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:02.893732 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.893700    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"]
Sep 10 15:38:02.895042 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:38:02.895013    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda35856a5_eb3a_41d5_9a1a_9b703faa63b6.slice/crio-6f42873d82733107c4d68e7275e4ae05c1d1c6984201fffd2d34a1bfabc97ec8 WatchSource:0}: Error finding container 6f42873d82733107c4d68e7275e4ae05c1d1c6984201fffd2d34a1bfabc97ec8: Status 404 returned error can't find the container with id 6f42873d82733107c4d68e7275e4ae05c1d1c6984201fffd2d34a1bfabc97ec8
Sep 10 15:38:02.897182 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.897149    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:38:02.897262 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.897215    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:38:02.897262 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:02.897242    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:38:03.150660 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:03.150574    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt" event={"ID":"a35856a5-eb3a-41d5-9a1a-9b703faa63b6","Type":"ContainerStarted","Data":"6273e49b7bd936729f85ef4d9dbd818c86b5b3326e35418475ea2aa914eb7dd1"}
Sep 10 15:38:03.150660 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:03.150622    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt" event={"ID":"a35856a5-eb3a-41d5-9a1a-9b703faa63b6","Type":"ContainerStarted","Data":"6f42873d82733107c4d68e7275e4ae05c1d1c6984201fffd2d34a1bfabc97ec8"}
Sep 10 15:38:03.173943 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:03.173887    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt" podStartSLOduration=1.173869755 podStartE2EDuration="1.173869755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:38:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:38:03.172364909 +0000 UTC m=+1336.222163433" watchObservedRunningTime="2026-09-10 15:38:03.173869755 +0000 UTC m=+1336.223668263"
Sep 10 15:38:03.616294 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:03.616253    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:03.621641 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:03.621615    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:04.156392 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:04.156362    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:04.157399 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:04.157376    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:09.514344 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:09.514296    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9" podUID="bfc40782-2bf3-4ed6-957e-48eb202892e4" containerName="main" containerID="cri-o://85c8f96010794368cfc88358de310d7314335e1d254bc5604e0c96ba1fa25fbd" gracePeriod=45
Sep 10 15:38:09.774805 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:09.774743    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:38:09.919281 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:09.919229    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8x82\" (UniqueName: \"kubernetes.io/projected/bfc40782-2bf3-4ed6-957e-48eb202892e4-kube-api-access-c8x82\") pod \"bfc40782-2bf3-4ed6-957e-48eb202892e4\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") "
Sep 10 15:38:09.919500 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:09.919304    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-model-cache\") pod \"bfc40782-2bf3-4ed6-957e-48eb202892e4\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") "
Sep 10 15:38:09.919500 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:09.919322    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-dshm\") pod \"bfc40782-2bf3-4ed6-957e-48eb202892e4\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") "
Sep 10 15:38:09.919500 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:09.919387    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-home\") pod \"bfc40782-2bf3-4ed6-957e-48eb202892e4\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") "
Sep 10 15:38:09.919500 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:09.919415    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-tmp-dir\") pod \"bfc40782-2bf3-4ed6-957e-48eb202892e4\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") "
Sep 10 15:38:09.919500 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:09.919456    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfc40782-2bf3-4ed6-957e-48eb202892e4-tls-certs\") pod \"bfc40782-2bf3-4ed6-957e-48eb202892e4\" (UID: \"bfc40782-2bf3-4ed6-957e-48eb202892e4\") "
Sep 10 15:38:09.919771 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:09.919591    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-model-cache" (OuterVolumeSpecName: "model-cache") pod "bfc40782-2bf3-4ed6-957e-48eb202892e4" (UID: "bfc40782-2bf3-4ed6-957e-48eb202892e4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:38:09.919771 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:09.919686    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bfc40782-2bf3-4ed6-957e-48eb202892e4" (UID: "bfc40782-2bf3-4ed6-957e-48eb202892e4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:38:09.919771 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:09.919709    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-home" (OuterVolumeSpecName: "home") pod "bfc40782-2bf3-4ed6-957e-48eb202892e4" (UID: "bfc40782-2bf3-4ed6-957e-48eb202892e4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:38:09.919914 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:09.919873    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-home\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:38:09.919914 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:09.919888    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-tmp-dir\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:38:09.919914 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:09.919897    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-model-cache\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:38:09.921624 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:09.921599    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfc40782-2bf3-4ed6-957e-48eb202892e4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bfc40782-2bf3-4ed6-957e-48eb202892e4" (UID: "bfc40782-2bf3-4ed6-957e-48eb202892e4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:38:09.921624 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:09.921606    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-dshm" (OuterVolumeSpecName: "dshm") pod "bfc40782-2bf3-4ed6-957e-48eb202892e4" (UID: "bfc40782-2bf3-4ed6-957e-48eb202892e4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:38:09.921777 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:09.921661    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfc40782-2bf3-4ed6-957e-48eb202892e4-kube-api-access-c8x82" (OuterVolumeSpecName: "kube-api-access-c8x82") pod "bfc40782-2bf3-4ed6-957e-48eb202892e4" (UID: "bfc40782-2bf3-4ed6-957e-48eb202892e4"). InnerVolumeSpecName "kube-api-access-c8x82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:38:10.021021 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:10.020987    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfc40782-2bf3-4ed6-957e-48eb202892e4-tls-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:38:10.021021 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:10.021017    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8x82\" (UniqueName: \"kubernetes.io/projected/bfc40782-2bf3-4ed6-957e-48eb202892e4-kube-api-access-c8x82\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:38:10.021021 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:10.021026    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfc40782-2bf3-4ed6-957e-48eb202892e4-dshm\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:38:10.191731 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:10.191697    2574 generic.go:356] "Generic (PLEG): container finished" podID="bfc40782-2bf3-4ed6-957e-48eb202892e4" containerID="85c8f96010794368cfc88358de310d7314335e1d254bc5604e0c96ba1fa25fbd" exitCode=0
Sep 10 15:38:10.191913 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:10.191738    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"
Sep 10 15:38:10.191913 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:10.191751    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9" event={"ID":"bfc40782-2bf3-4ed6-957e-48eb202892e4","Type":"ContainerDied","Data":"85c8f96010794368cfc88358de310d7314335e1d254bc5604e0c96ba1fa25fbd"}
Sep 10 15:38:10.191913 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:10.191782    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9" event={"ID":"bfc40782-2bf3-4ed6-957e-48eb202892e4","Type":"ContainerDied","Data":"2b1777e34d8699a219d467925363a1ea3a3bd6e89083983003eadf1ad429e9a4"}
Sep 10 15:38:10.191913 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:10.191799    2574 scope.go:117] "RemoveContainer" containerID="85c8f96010794368cfc88358de310d7314335e1d254bc5604e0c96ba1fa25fbd"
Sep 10 15:38:10.201882 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:10.201865    2574 scope.go:117] "RemoveContainer" containerID="85c8f96010794368cfc88358de310d7314335e1d254bc5604e0c96ba1fa25fbd"
Sep 10 15:38:10.202199 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:38:10.202180    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85c8f96010794368cfc88358de310d7314335e1d254bc5604e0c96ba1fa25fbd\": container with ID starting with 85c8f96010794368cfc88358de310d7314335e1d254bc5604e0c96ba1fa25fbd not found: ID does not exist" containerID="85c8f96010794368cfc88358de310d7314335e1d254bc5604e0c96ba1fa25fbd"
Sep 10 15:38:10.202253 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:10.202209    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85c8f96010794368cfc88358de310d7314335e1d254bc5604e0c96ba1fa25fbd"} err="failed to get container status \"85c8f96010794368cfc88358de310d7314335e1d254bc5604e0c96ba1fa25fbd\": rpc error: code = NotFound desc = could not find container \"85c8f96010794368cfc88358de310d7314335e1d254bc5604e0c96ba1fa25fbd\": container with ID starting with 85c8f96010794368cfc88358de310d7314335e1d254bc5604e0c96ba1fa25fbd not found: ID does not exist"
Sep 10 15:38:10.218036 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:10.218007    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"]
Sep 10 15:38:10.220525 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:10.220499    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-62d2f7/auth-test-model-62d2f7-kserve-d645b7fd7-cz5q9"]
Sep 10 15:38:11.409518 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:11.409483    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfc40782-2bf3-4ed6-957e-48eb202892e4" path="/var/lib/kubelet/pods/bfc40782-2bf3-4ed6-957e-48eb202892e4/volumes"
Sep 10 15:38:36.047569 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.047532    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"]
Sep 10 15:38:36.048808 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.048781    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="950c4b19-abb6-4434-93b2-028cf362a379" containerName="istio-proxy"
Sep 10 15:38:36.048982 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.048961    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="950c4b19-abb6-4434-93b2-028cf362a379" containerName="istio-proxy"
Sep 10 15:38:36.049131 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.049019    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfc40782-2bf3-4ed6-957e-48eb202892e4" containerName="main"
Sep 10 15:38:36.049131 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.049029    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfc40782-2bf3-4ed6-957e-48eb202892e4" containerName="main"
Sep 10 15:38:36.049241 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.049139    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfc40782-2bf3-4ed6-957e-48eb202892e4" containerName="main"
Sep 10 15:38:36.055967 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.055942    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.060026 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.059995    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-bbc967-openshift-default-dockercfg-5sdjl\""
Sep 10 15:38:36.069563 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.069538    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"]
Sep 10 15:38:36.170619 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.170589    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-istio-data\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.170778 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.170635    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-credential-socket\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.170778 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.170656    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b109cc5-a589-4598-aaca-271da0eaa404-istio-token\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.170778 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.170708    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v4zv\" (UniqueName: \"kubernetes.io/projected/1b109cc5-a589-4598-aaca-271da0eaa404-kube-api-access-4v4zv\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.170778 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.170731    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-istio-envoy\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.171042 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.170823    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b109cc5-a589-4598-aaca-271da0eaa404-istio-podinfo\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.171042 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.170884    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-workload-certs\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.171042 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.171006    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b109cc5-a589-4598-aaca-271da0eaa404-istiod-ca-cert\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.171042 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.171032    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-workload-socket\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.271641 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.271603    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b109cc5-a589-4598-aaca-271da0eaa404-istio-podinfo\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.271834 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.271657    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-workload-certs\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.271834 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.271713    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b109cc5-a589-4598-aaca-271da0eaa404-istiod-ca-cert\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.271834 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.271727    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-workload-socket\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.271834 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.271794    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-istio-data\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.272098 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.271847    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-credential-socket\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.272098 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.271876    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b109cc5-a589-4598-aaca-271da0eaa404-istio-token\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.272098 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.271923    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v4zv\" (UniqueName: \"kubernetes.io/projected/1b109cc5-a589-4598-aaca-271da0eaa404-kube-api-access-4v4zv\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.272098 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.271989    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-istio-envoy\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.272293 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.272211    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-istio-data\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.272350 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.272310    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-credential-socket\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.272623 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.272594    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b109cc5-a589-4598-aaca-271da0eaa404-istiod-ca-cert\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.272623 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.272612    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-workload-socket\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.272766 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.272600    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-workload-certs\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.274319 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.274299    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-istio-envoy\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.274694 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.274678    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b109cc5-a589-4598-aaca-271da0eaa404-istio-podinfo\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.280822 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.280790    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b109cc5-a589-4598-aaca-271da0eaa404-istio-token\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.281507 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.281484    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v4zv\" (UniqueName: \"kubernetes.io/projected/1b109cc5-a589-4598-aaca-271da0eaa404-kube-api-access-4v4zv\") pod \"e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") " pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.367728 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.367646    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:36.658057 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.658030    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"]
Sep 10 15:38:36.660789 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:38:36.660754    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b109cc5_a589_4598_aaca_271da0eaa404.slice/crio-f22063d333e2057dd333d88350effec1913e5fb090cb21dd449b73825bf7683e WatchSource:0}: Error finding container f22063d333e2057dd333d88350effec1913e5fb090cb21dd449b73825bf7683e: Status 404 returned error can't find the container with id f22063d333e2057dd333d88350effec1913e5fb090cb21dd449b73825bf7683e
Sep 10 15:38:36.663557 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.663517    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:38:36.663660 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.663608    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:38:36.663701 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:36.663659    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:38:37.361447 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:37.361406    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx" event={"ID":"1b109cc5-a589-4598-aaca-271da0eaa404","Type":"ContainerStarted","Data":"6ccb49121969844d55cc596aacc5abe51643a2d04941699c66dab49fe71df728"}
Sep 10 15:38:37.361842 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:37.361463    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx" event={"ID":"1b109cc5-a589-4598-aaca-271da0eaa404","Type":"ContainerStarted","Data":"f22063d333e2057dd333d88350effec1913e5fb090cb21dd449b73825bf7683e"}
Sep 10 15:38:37.367838 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:37.367813    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:37.373236 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:37.373208    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:37.391540 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:37.391474    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx" podStartSLOduration=1.391454926 podStartE2EDuration="1.391454926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:38:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:38:37.389837123 +0000 UTC m=+1370.439635632" watchObservedRunningTime="2026-09-10 15:38:37.391454926 +0000 UTC m=+1370.441253434"
Sep 10 15:38:38.366837 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:38.366796    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:38.367987 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:38.367966    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:39.374551 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:39.374518    2574 generic.go:356] "Generic (PLEG): container finished" podID="a35856a5-eb3a-41d5-9a1a-9b703faa63b6" containerID="6273e49b7bd936729f85ef4d9dbd818c86b5b3326e35418475ea2aa914eb7dd1" exitCode=0
Sep 10 15:38:39.374971 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:39.374596    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt" event={"ID":"a35856a5-eb3a-41d5-9a1a-9b703faa63b6","Type":"ContainerDied","Data":"6273e49b7bd936729f85ef4d9dbd818c86b5b3326e35418475ea2aa914eb7dd1"}
Sep 10 15:38:39.375159 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:39.375144    2574 scope.go:117] "RemoveContainer" containerID="6273e49b7bd936729f85ef4d9dbd818c86b5b3326e35418475ea2aa914eb7dd1"
Sep 10 15:38:39.376319 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:39.376293    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:38:39.376398 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:39.376360    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:38:39.376398 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:39.376394    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:38:40.383582 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.383542    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt" event={"ID":"a35856a5-eb3a-41d5-9a1a-9b703faa63b6","Type":"ContainerStarted","Data":"7431e426cb4acf04db4351232122ece52f0d4dfb8ef7c552a18ce7feca50611c"}
Sep 10 15:38:40.467874 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.467833    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"]
Sep 10 15:38:40.471211 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.471185    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"
Sep 10 15:38:40.474571 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.474549    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 15:38:40.474872 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.474846    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gljcp\""
Sep 10 15:38:40.475006 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.474846    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 15:38:40.475006 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.474917    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 15:38:40.475140 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.474853    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-bbc967-serving-cert\""
Sep 10 15:38:40.483610 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.483587    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"]
Sep 10 15:38:40.617117 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.617084    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:40.617321 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.617284    2574 patch_prober.go:28] interesting pod/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 10 15:38:40.617407 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.617343    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt" podUID="a35856a5-eb3a-41d5-9a1a-9b703faa63b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 10 15:38:40.621153 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.621130    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5ds9\" (UniqueName: \"kubernetes.io/projected/a9ac01f6-7fa4-42b1-b446-00b790498e8d-kube-api-access-l5ds9\") pod \"maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr\" (UID: \"a9ac01f6-7fa4-42b1-b446-00b790498e8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"
Sep 10 15:38:40.621246 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.621185    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9ac01f6-7fa4-42b1-b446-00b790498e8d-maas-api-tls\") pod \"maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr\" (UID: \"a9ac01f6-7fa4-42b1-b446-00b790498e8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"
Sep 10 15:38:40.621286 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.621245    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9ac01f6-7fa4-42b1-b446-00b790498e8d-openshift-service-ca\") pod \"maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr\" (UID: \"a9ac01f6-7fa4-42b1-b446-00b790498e8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"
Sep 10 15:38:40.621325 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.621290    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9ac01f6-7fa4-42b1-b446-00b790498e8d-metrics-certs\") pod \"maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr\" (UID: \"a9ac01f6-7fa4-42b1-b446-00b790498e8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"
Sep 10 15:38:40.722400 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.722308    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9ac01f6-7fa4-42b1-b446-00b790498e8d-maas-api-tls\") pod \"maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr\" (UID: \"a9ac01f6-7fa4-42b1-b446-00b790498e8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"
Sep 10 15:38:40.722400 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.722366    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9ac01f6-7fa4-42b1-b446-00b790498e8d-openshift-service-ca\") pod \"maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr\" (UID: \"a9ac01f6-7fa4-42b1-b446-00b790498e8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"
Sep 10 15:38:40.722596 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.722418    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9ac01f6-7fa4-42b1-b446-00b790498e8d-metrics-certs\") pod \"maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr\" (UID: \"a9ac01f6-7fa4-42b1-b446-00b790498e8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"
Sep 10 15:38:40.722596 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.722467    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5ds9\" (UniqueName: \"kubernetes.io/projected/a9ac01f6-7fa4-42b1-b446-00b790498e8d-kube-api-access-l5ds9\") pod \"maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr\" (UID: \"a9ac01f6-7fa4-42b1-b446-00b790498e8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"
Sep 10 15:38:40.722596 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:38:40.722470    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-serving-cert: secret "maas-api-e2e-api-b-bbc967-serving-cert" not found
Sep 10 15:38:40.722596 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:38:40.722538    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9ac01f6-7fa4-42b1-b446-00b790498e8d-maas-api-tls podName:a9ac01f6-7fa4-42b1-b446-00b790498e8d nodeName:}" failed. No retries permitted until 2026-09-10 15:38:41.222518509 +0000 UTC m=+1374.272316994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a9ac01f6-7fa4-42b1-b446-00b790498e8d-maas-api-tls") pod "maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr" (UID: "a9ac01f6-7fa4-42b1-b446-00b790498e8d") : secret "maas-api-e2e-api-b-bbc967-serving-cert" not found
Sep 10 15:38:40.723189 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.723170    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9ac01f6-7fa4-42b1-b446-00b790498e8d-openshift-service-ca\") pod \"maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr\" (UID: \"a9ac01f6-7fa4-42b1-b446-00b790498e8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"
Sep 10 15:38:40.725066 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.725044    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9ac01f6-7fa4-42b1-b446-00b790498e8d-metrics-certs\") pod \"maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr\" (UID: \"a9ac01f6-7fa4-42b1-b446-00b790498e8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"
Sep 10 15:38:40.735192 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:40.735140    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5ds9\" (UniqueName: \"kubernetes.io/projected/a9ac01f6-7fa4-42b1-b446-00b790498e8d-kube-api-access-l5ds9\") pod \"maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr\" (UID: \"a9ac01f6-7fa4-42b1-b446-00b790498e8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"
Sep 10 15:38:41.227659 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:41.227613    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9ac01f6-7fa4-42b1-b446-00b790498e8d-maas-api-tls\") pod \"maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr\" (UID: \"a9ac01f6-7fa4-42b1-b446-00b790498e8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"
Sep 10 15:38:41.231354 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:41.231324    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9ac01f6-7fa4-42b1-b446-00b790498e8d-maas-api-tls\") pod \"maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr\" (UID: \"a9ac01f6-7fa4-42b1-b446-00b790498e8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"
Sep 10 15:38:41.385228 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:41.385195    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"
Sep 10 15:38:41.617047 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:41.617006    2574 patch_prober.go:28] interesting pod/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 10 15:38:41.617226 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:41.617079    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt" podUID="a35856a5-eb3a-41d5-9a1a-9b703faa63b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 10 15:38:41.693818 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:41.693793    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"]
Sep 10 15:38:41.695305 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:38:41.695277    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ac01f6_7fa4_42b1_b446_00b790498e8d.slice/crio-e78ca723fcd96d70ea269eea5cea747d418adb94a4ac049a1068c9e6fa4aa1a4 WatchSource:0}: Error finding container e78ca723fcd96d70ea269eea5cea747d418adb94a4ac049a1068c9e6fa4aa1a4: Status 404 returned error can't find the container with id e78ca723fcd96d70ea269eea5cea747d418adb94a4ac049a1068c9e6fa4aa1a4
Sep 10 15:38:42.404699 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:42.404623    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr" event={"ID":"a9ac01f6-7fa4-42b1-b446-00b790498e8d","Type":"ContainerStarted","Data":"e78ca723fcd96d70ea269eea5cea747d418adb94a4ac049a1068c9e6fa4aa1a4"}
Sep 10 15:38:42.617381 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:42.616913    2574 patch_prober.go:28] interesting pod/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 10 15:38:42.617381 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:42.616998    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt" podUID="a35856a5-eb3a-41d5-9a1a-9b703faa63b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 10 15:38:43.616615 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:43.616570    2574 patch_prober.go:28] interesting pod/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 10 15:38:43.617112 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:43.616648    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt" podUID="a35856a5-eb3a-41d5-9a1a-9b703faa63b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 10 15:38:44.617066 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:44.617042    2574 patch_prober.go:28] interesting pod/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 10 15:38:44.617369 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:44.617092    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt" podUID="a35856a5-eb3a-41d5-9a1a-9b703faa63b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 10 15:38:45.429710 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:45.429667    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr" event={"ID":"a9ac01f6-7fa4-42b1-b446-00b790498e8d","Type":"ContainerStarted","Data":"1ed7bf74917a20960e67586ab7ed5cf74225e59f7a9184d6d6cac6fdf1fa04ce"}
Sep 10 15:38:45.429954 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:45.429809    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"
Sep 10 15:38:45.452551 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:45.452490    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr" podStartSLOduration=2.56350749 podStartE2EDuration="5.452473708s" totalImagesPullingTime="2.888966218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:38:45.450152285 +0000 UTC m=+1378.499950809" watchObservedRunningTime="2026-09-10 15:38:45.452473708 +0000 UTC m=+1378.502272216"
Sep 10 15:38:45.621118 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:45.621081    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:45.621528 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:45.621510    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:45.622350 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:45.622328    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:38:48.869334 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:48.869299    2574 scope.go:117] "RemoveContainer" containerID="8e305fc8d73448272b4f209755505b88f0eae317012fbddf13cd2e9194d2ad08"
Sep 10 15:38:48.878355 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:48.878334    2574 scope.go:117] "RemoveContainer" containerID="62da0f86c7efd91e14e18fa3230dabec83c97780bb0f34b7f5c34e20ab130310"
Sep 10 15:38:51.453267 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:51.453228    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"
Sep 10 15:38:54.409068 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:54.409035    2574 patch_prober.go:28] interesting pod/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 15:38:54.409445 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:54.409089    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx" podUID="1b109cc5-a589-4598-aaca-271da0eaa404" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 15:38:56.507302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:56.507269    2574 generic.go:356] "Generic (PLEG): container finished" podID="1b109cc5-a589-4598-aaca-271da0eaa404" containerID="6ccb49121969844d55cc596aacc5abe51643a2d04941699c66dab49fe71df728" exitCode=0
Sep 10 15:38:56.507778 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:56.507338    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx" event={"ID":"1b109cc5-a589-4598-aaca-271da0eaa404","Type":"ContainerDied","Data":"6ccb49121969844d55cc596aacc5abe51643a2d04941699c66dab49fe71df728"}
Sep 10 15:38:56.507778 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:56.507725    2574 scope.go:117] "RemoveContainer" containerID="6ccb49121969844d55cc596aacc5abe51643a2d04941699c66dab49fe71df728"
Sep 10 15:38:56.508866 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:56.508835    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:38:56.509003 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:56.508919    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:38:56.509003 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:56.508989    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:38:57.518083 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:57.518036    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx" event={"ID":"1b109cc5-a589-4598-aaca-271da0eaa404","Type":"ContainerStarted","Data":"702fd370a9ca4d01e31553e9ac2ce79688f008484cd92a8dc3ca45947d327337"}
Sep 10 15:38:58.367882 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:58.367846    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:38:58.368214 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:58.368186    2574 patch_prober.go:28] interesting pod/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 15:38:58.368303 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:58.368255    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx" podUID="1b109cc5-a589-4598-aaca-271da0eaa404" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 15:38:59.368881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:59.368838    2574 patch_prober.go:28] interesting pod/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 15:38:59.369305 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:38:59.368902    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx" podUID="1b109cc5-a589-4598-aaca-271da0eaa404" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 15:39:00.368886 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:00.368845    2574 patch_prober.go:28] interesting pod/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 15:39:00.369326 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:00.368905    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx" podUID="1b109cc5-a589-4598-aaca-271da0eaa404" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 15:39:01.368199 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:01.368164    2574 patch_prober.go:28] interesting pod/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 15:39:01.368396 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:01.368229    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx" podUID="1b109cc5-a589-4598-aaca-271da0eaa404" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 15:39:02.368328 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:02.368289    2574 patch_prober.go:28] interesting pod/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 15:39:02.368745 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:02.368358    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx" podUID="1b109cc5-a589-4598-aaca-271da0eaa404" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 15:39:03.371708 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:03.371679    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:39:03.372178 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:03.371963    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:39:03.372849 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:03.372832    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:39:27.818752 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:27.818716    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7824-1557cb"]
Sep 10 15:39:27.822324 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:27.822304    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7824-1557cb"
Sep 10 15:39:27.825287 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:27.825264    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-h7f4v\""
Sep 10 15:39:27.830001 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:27.829971    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7824-1557cb"]
Sep 10 15:39:27.937016 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:27.936973    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw6pr\" (UniqueName: \"kubernetes.io/projected/93d4cbcd-d54a-4b07-814a-7c904635d79a-kube-api-access-jw6pr\") pod \"test-curl-7824-1557cb\" (UID: \"93d4cbcd-d54a-4b07-814a-7c904635d79a\") " pod="opendatahub/test-curl-7824-1557cb"
Sep 10 15:39:28.037788 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:28.037752    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw6pr\" (UniqueName: \"kubernetes.io/projected/93d4cbcd-d54a-4b07-814a-7c904635d79a-kube-api-access-jw6pr\") pod \"test-curl-7824-1557cb\" (UID: \"93d4cbcd-d54a-4b07-814a-7c904635d79a\") " pod="opendatahub/test-curl-7824-1557cb"
Sep 10 15:39:28.053367 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:28.053332    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw6pr\" (UniqueName: \"kubernetes.io/projected/93d4cbcd-d54a-4b07-814a-7c904635d79a-kube-api-access-jw6pr\") pod \"test-curl-7824-1557cb\" (UID: \"93d4cbcd-d54a-4b07-814a-7c904635d79a\") " pod="opendatahub/test-curl-7824-1557cb"
Sep 10 15:39:28.133429 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:28.133348    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7824-1557cb"
Sep 10 15:39:28.406736 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:28.406711    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7824-1557cb"]
Sep 10 15:39:28.408277 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:39:28.408244    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93d4cbcd_d54a_4b07_814a_7c904635d79a.slice/crio-4f76c636a464a53a563cb0594b1edc353dea13a99046f93828ce3130af092374 WatchSource:0}: Error finding container 4f76c636a464a53a563cb0594b1edc353dea13a99046f93828ce3130af092374: Status 404 returned error can't find the container with id 4f76c636a464a53a563cb0594b1edc353dea13a99046f93828ce3130af092374
Sep 10 15:39:28.708860 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:28.708767    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7824-1557cb" event={"ID":"93d4cbcd-d54a-4b07-814a-7c904635d79a","Type":"ContainerStarted","Data":"3ff1a7c64111809de683f1457712b1815f5b29f674b947449919af9253352c06"}
Sep 10 15:39:28.708860 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:28.708812    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7824-1557cb" event={"ID":"93d4cbcd-d54a-4b07-814a-7c904635d79a","Type":"ContainerStarted","Data":"4f76c636a464a53a563cb0594b1edc353dea13a99046f93828ce3130af092374"}
Sep 10 15:39:28.726115 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:28.726059    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7824-1557cb" podStartSLOduration=1.726043311 podStartE2EDuration="1.726043311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:39:28.724075144 +0000 UTC m=+1421.773873655" watchObservedRunningTime="2026-09-10 15:39:28.726043311 +0000 UTC m=+1421.775841818"
Sep 10 15:39:29.322351 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:29.322279    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7824-1557cb"]
Sep 10 15:39:29.324994 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:29.324964    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7824-1557cb"]
Sep 10 15:39:29.454526 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:29.454451    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7824-bb27dd"]
Sep 10 15:39:29.454858 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:29.454845    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93d4cbcd-d54a-4b07-814a-7c904635d79a" containerName="test-curl-7824-1557cb"
Sep 10 15:39:29.454906 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:29.454860    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="93d4cbcd-d54a-4b07-814a-7c904635d79a" containerName="test-curl-7824-1557cb"
Sep 10 15:39:29.454970 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:29.454960    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="93d4cbcd-d54a-4b07-814a-7c904635d79a" containerName="test-curl-7824-1557cb"
Sep 10 15:39:29.458019 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:29.458005    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7824-bb27dd"
Sep 10 15:39:29.480195 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:29.480165    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7824-bb27dd"]
Sep 10 15:39:29.654745 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:29.654691    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-428hc\" (UniqueName: \"kubernetes.io/projected/8b6cf8a0-4505-49db-a513-ca93fc5992f8-kube-api-access-428hc\") pod \"test-curl-7824-bb27dd\" (UID: \"8b6cf8a0-4505-49db-a513-ca93fc5992f8\") " pod="opendatahub/test-curl-7824-bb27dd"
Sep 10 15:39:29.714911 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:39:29.714828    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7824-1557cb" container="test-curl-7824-1557cb"
Sep 10 15:39:29.756086 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:29.756058    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-428hc\" (UniqueName: \"kubernetes.io/projected/8b6cf8a0-4505-49db-a513-ca93fc5992f8-kube-api-access-428hc\") pod \"test-curl-7824-bb27dd\" (UID: \"8b6cf8a0-4505-49db-a513-ca93fc5992f8\") " pod="opendatahub/test-curl-7824-bb27dd"
Sep 10 15:39:29.767285 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:29.767247    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-428hc\" (UniqueName: \"kubernetes.io/projected/8b6cf8a0-4505-49db-a513-ca93fc5992f8-kube-api-access-428hc\") pod \"test-curl-7824-bb27dd\" (UID: \"8b6cf8a0-4505-49db-a513-ca93fc5992f8\") " pod="opendatahub/test-curl-7824-bb27dd"
Sep 10 15:39:29.922556 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:29.922524    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"]
Sep 10 15:39:29.922764 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:29.922742    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt" podUID="a35856a5-eb3a-41d5-9a1a-9b703faa63b6" containerName="istio-proxy" containerID="cri-o://7431e426cb4acf04db4351232122ece52f0d4dfb8ef7c552a18ce7feca50611c" gracePeriod=30
Sep 10 15:39:30.066606 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:30.066570    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7824-bb27dd"
Sep 10 15:39:30.339580 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:30.339554    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7824-bb27dd"]
Sep 10 15:39:30.341110 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:39:30.341078    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b6cf8a0_4505_49db_a513_ca93fc5992f8.slice/crio-2a0edff2f3149187db1d3d500cd262035a4edddd3ae1b067ae166c37ad0599be WatchSource:0}: Error finding container 2a0edff2f3149187db1d3d500cd262035a4edddd3ae1b067ae166c37ad0599be: Status 404 returned error can't find the container with id 2a0edff2f3149187db1d3d500cd262035a4edddd3ae1b067ae166c37ad0599be
Sep 10 15:39:30.623429 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:30.623343    2574 patch_prober.go:28] interesting pod/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 15:39:30.623429 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:30.623398    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt" podUID="a35856a5-eb3a-41d5-9a1a-9b703faa63b6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 15:39:30.722107 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:30.722069    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7824-bb27dd" event={"ID":"8b6cf8a0-4505-49db-a513-ca93fc5992f8","Type":"ContainerStarted","Data":"795dfba8af0bd8edc82c1daf3d9d47f6ad7555ebf00a9093b8fee1b44eede8ef"}
Sep 10 15:39:30.722275 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:30.722122    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7824-bb27dd" event={"ID":"8b6cf8a0-4505-49db-a513-ca93fc5992f8","Type":"ContainerStarted","Data":"2a0edff2f3149187db1d3d500cd262035a4edddd3ae1b067ae166c37ad0599be"}
Sep 10 15:39:30.722354 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:30.722328    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7824-1557cb" podUID="93d4cbcd-d54a-4b07-814a-7c904635d79a" containerName="test-curl-7824-1557cb" containerID="cri-o://3ff1a7c64111809de683f1457712b1815f5b29f674b947449919af9253352c06" gracePeriod=2
Sep 10 15:39:30.738808 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:30.738759    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7824-bb27dd" podStartSLOduration=1.7387431819999999 podStartE2EDuration="1.738743182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:39:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:39:30.736369673 +0000 UTC m=+1423.786168182" watchObservedRunningTime="2026-09-10 15:39:30.738743182 +0000 UTC m=+1423.788541726"
Sep 10 15:39:31.326424 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:31.326382    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7824-bb27dd"]
Sep 10 15:39:31.330382 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:31.330354    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7824-bb27dd"]
Sep 10 15:39:31.728952 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:39:31.728860    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7824-bb27dd" container="test-curl-7824-bb27dd"
Sep 10 15:39:32.734812 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:32.734751    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7824-bb27dd" podUID="8b6cf8a0-4505-49db-a513-ca93fc5992f8" containerName="test-curl-7824-bb27dd" containerID="cri-o://795dfba8af0bd8edc82c1daf3d9d47f6ad7555ebf00a9093b8fee1b44eede8ef" gracePeriod=2
Sep 10 15:39:32.888606 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:32.888580    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7824-1557cb"
Sep 10 15:39:32.987319 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:32.987207    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jw6pr\" (UniqueName: \"kubernetes.io/projected/93d4cbcd-d54a-4b07-814a-7c904635d79a-kube-api-access-jw6pr\") pod \"93d4cbcd-d54a-4b07-814a-7c904635d79a\" (UID: \"93d4cbcd-d54a-4b07-814a-7c904635d79a\") "
Sep 10 15:39:32.989276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:32.989245    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93d4cbcd-d54a-4b07-814a-7c904635d79a-kube-api-access-jw6pr" (OuterVolumeSpecName: "kube-api-access-jw6pr") pod "93d4cbcd-d54a-4b07-814a-7c904635d79a" (UID: "93d4cbcd-d54a-4b07-814a-7c904635d79a"). InnerVolumeSpecName "kube-api-access-jw6pr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:39:33.088208 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:33.088169    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jw6pr\" (UniqueName: \"kubernetes.io/projected/93d4cbcd-d54a-4b07-814a-7c904635d79a-kube-api-access-jw6pr\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:33.409174 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:33.409145    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93d4cbcd-d54a-4b07-814a-7c904635d79a" path="/var/lib/kubelet/pods/93d4cbcd-d54a-4b07-814a-7c904635d79a/volumes"
Sep 10 15:39:33.741772 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:33.741680    2574 generic.go:356] "Generic (PLEG): container finished" podID="93d4cbcd-d54a-4b07-814a-7c904635d79a" containerID="3ff1a7c64111809de683f1457712b1815f5b29f674b947449919af9253352c06" exitCode=137
Sep 10 15:39:33.741772 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:33.741718    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7824-1557cb"
Sep 10 15:39:33.741772 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:33.741771    2574 scope.go:117] "RemoveContainer" containerID="3ff1a7c64111809de683f1457712b1815f5b29f674b947449919af9253352c06"
Sep 10 15:39:33.751097 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:33.751037    2574 scope.go:117] "RemoveContainer" containerID="3ff1a7c64111809de683f1457712b1815f5b29f674b947449919af9253352c06"
Sep 10 15:39:33.751321 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:39:33.751300    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ff1a7c64111809de683f1457712b1815f5b29f674b947449919af9253352c06\": container with ID starting with 3ff1a7c64111809de683f1457712b1815f5b29f674b947449919af9253352c06 not found: ID does not exist" containerID="3ff1a7c64111809de683f1457712b1815f5b29f674b947449919af9253352c06"
Sep 10 15:39:33.751371 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:33.751330    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ff1a7c64111809de683f1457712b1815f5b29f674b947449919af9253352c06"} err="failed to get container status \"3ff1a7c64111809de683f1457712b1815f5b29f674b947449919af9253352c06\": rpc error: code = NotFound desc = could not find container \"3ff1a7c64111809de683f1457712b1815f5b29f674b947449919af9253352c06\": container with ID starting with 3ff1a7c64111809de683f1457712b1815f5b29f674b947449919af9253352c06 not found: ID does not exist"
Sep 10 15:39:34.915367 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:34.915344    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7824-bb27dd"
Sep 10 15:39:35.008289 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.008208    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-428hc\" (UniqueName: \"kubernetes.io/projected/8b6cf8a0-4505-49db-a513-ca93fc5992f8-kube-api-access-428hc\") pod \"8b6cf8a0-4505-49db-a513-ca93fc5992f8\" (UID: \"8b6cf8a0-4505-49db-a513-ca93fc5992f8\") "
Sep 10 15:39:35.010293 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.010258    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b6cf8a0-4505-49db-a513-ca93fc5992f8-kube-api-access-428hc" (OuterVolumeSpecName: "kube-api-access-428hc") pod "8b6cf8a0-4505-49db-a513-ca93fc5992f8" (UID: "8b6cf8a0-4505-49db-a513-ca93fc5992f8"). InnerVolumeSpecName "kube-api-access-428hc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:39:35.109863 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.109829    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-428hc\" (UniqueName: \"kubernetes.io/projected/8b6cf8a0-4505-49db-a513-ca93fc5992f8-kube-api-access-428hc\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:35.170723 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.170698    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:39:35.210924 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.210897    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-envoy\") pod \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") "
Sep 10 15:39:35.211121 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.210968    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istiod-ca-cert\") pod \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") "
Sep 10 15:39:35.211121 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.210992    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccjlv\" (UniqueName: \"kubernetes.io/projected/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-kube-api-access-ccjlv\") pod \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") "
Sep 10 15:39:35.211121 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.211076    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-credential-socket\") pod \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") "
Sep 10 15:39:35.211298 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.211131    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-token\") pod \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") "
Sep 10 15:39:35.211298 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.211193    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-podinfo\") pod \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") "
Sep 10 15:39:35.211298 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.211218    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-data\") pod \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") "
Sep 10 15:39:35.211298 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.211286    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-workload-certs\") pod \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") "
Sep 10 15:39:35.211505 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.211315    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-workload-socket\") pod \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\" (UID: \"a35856a5-eb3a-41d5-9a1a-9b703faa63b6\") "
Sep 10 15:39:35.211505 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.211479    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a35856a5-eb3a-41d5-9a1a-9b703faa63b6" (UID: "a35856a5-eb3a-41d5-9a1a-9b703faa63b6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:39:35.211618 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.211524    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a35856a5-eb3a-41d5-9a1a-9b703faa63b6" (UID: "a35856a5-eb3a-41d5-9a1a-9b703faa63b6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:39:35.211680 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.211648    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a35856a5-eb3a-41d5-9a1a-9b703faa63b6" (UID: "a35856a5-eb3a-41d5-9a1a-9b703faa63b6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:39:35.211737 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.211692    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-data" (OuterVolumeSpecName: "istio-data") pod "a35856a5-eb3a-41d5-9a1a-9b703faa63b6" (UID: "a35856a5-eb3a-41d5-9a1a-9b703faa63b6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:39:35.211916 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.211757    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a35856a5-eb3a-41d5-9a1a-9b703faa63b6" (UID: "a35856a5-eb3a-41d5-9a1a-9b703faa63b6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:39:35.211916 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.211713    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istiod-ca-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:35.212075 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.211962    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-credential-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:35.213658 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.213626    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-token" (OuterVolumeSpecName: "istio-token") pod "a35856a5-eb3a-41d5-9a1a-9b703faa63b6" (UID: "a35856a5-eb3a-41d5-9a1a-9b703faa63b6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:39:35.213766 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.213748    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a35856a5-eb3a-41d5-9a1a-9b703faa63b6" (UID: "a35856a5-eb3a-41d5-9a1a-9b703faa63b6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:39:35.213841 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.213825    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a35856a5-eb3a-41d5-9a1a-9b703faa63b6" (UID: "a35856a5-eb3a-41d5-9a1a-9b703faa63b6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:39:35.213881 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.213869    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-kube-api-access-ccjlv" (OuterVolumeSpecName: "kube-api-access-ccjlv") pod "a35856a5-eb3a-41d5-9a1a-9b703faa63b6" (UID: "a35856a5-eb3a-41d5-9a1a-9b703faa63b6"). InnerVolumeSpecName "kube-api-access-ccjlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:39:35.312821 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.312789    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-token\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:35.312821 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.312817    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-podinfo\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:35.312821 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.312826    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-data\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:35.313090 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.312835    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-workload-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:35.313090 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.312843    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-workload-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:35.313090 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.312851    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-istio-envoy\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:35.313090 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.312861    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccjlv\" (UniqueName: \"kubernetes.io/projected/a35856a5-eb3a-41d5-9a1a-9b703faa63b6-kube-api-access-ccjlv\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:35.410407 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.410364    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b6cf8a0-4505-49db-a513-ca93fc5992f8" path="/var/lib/kubelet/pods/8b6cf8a0-4505-49db-a513-ca93fc5992f8/volumes"
Sep 10 15:39:35.757915 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.757881    2574 generic.go:356] "Generic (PLEG): container finished" podID="a35856a5-eb3a-41d5-9a1a-9b703faa63b6" containerID="7431e426cb4acf04db4351232122ece52f0d4dfb8ef7c552a18ce7feca50611c" exitCode=0
Sep 10 15:39:35.758100 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.757951    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"
Sep 10 15:39:35.758100 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.757974    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt" event={"ID":"a35856a5-eb3a-41d5-9a1a-9b703faa63b6","Type":"ContainerDied","Data":"7431e426cb4acf04db4351232122ece52f0d4dfb8ef7c552a18ce7feca50611c"}
Sep 10 15:39:35.758100 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.758035    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt" event={"ID":"a35856a5-eb3a-41d5-9a1a-9b703faa63b6","Type":"ContainerDied","Data":"6f42873d82733107c4d68e7275e4ae05c1d1c6984201fffd2d34a1bfabc97ec8"}
Sep 10 15:39:35.758100 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.758065    2574 scope.go:117] "RemoveContainer" containerID="7431e426cb4acf04db4351232122ece52f0d4dfb8ef7c552a18ce7feca50611c"
Sep 10 15:39:35.759404 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.759370    2574 generic.go:356] "Generic (PLEG): container finished" podID="8b6cf8a0-4505-49db-a513-ca93fc5992f8" containerID="795dfba8af0bd8edc82c1daf3d9d47f6ad7555ebf00a9093b8fee1b44eede8ef" exitCode=137
Sep 10 15:39:35.759404 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.759402    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7824-bb27dd"
Sep 10 15:39:35.767323 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.767305    2574 scope.go:117] "RemoveContainer" containerID="6273e49b7bd936729f85ef4d9dbd818c86b5b3326e35418475ea2aa914eb7dd1"
Sep 10 15:39:35.778909 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.777174    2574 scope.go:117] "RemoveContainer" containerID="7431e426cb4acf04db4351232122ece52f0d4dfb8ef7c552a18ce7feca50611c"
Sep 10 15:39:35.778909 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:39:35.777513    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7431e426cb4acf04db4351232122ece52f0d4dfb8ef7c552a18ce7feca50611c\": container with ID starting with 7431e426cb4acf04db4351232122ece52f0d4dfb8ef7c552a18ce7feca50611c not found: ID does not exist" containerID="7431e426cb4acf04db4351232122ece52f0d4dfb8ef7c552a18ce7feca50611c"
Sep 10 15:39:35.778909 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.777542    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7431e426cb4acf04db4351232122ece52f0d4dfb8ef7c552a18ce7feca50611c"} err="failed to get container status \"7431e426cb4acf04db4351232122ece52f0d4dfb8ef7c552a18ce7feca50611c\": rpc error: code = NotFound desc = could not find container \"7431e426cb4acf04db4351232122ece52f0d4dfb8ef7c552a18ce7feca50611c\": container with ID starting with 7431e426cb4acf04db4351232122ece52f0d4dfb8ef7c552a18ce7feca50611c not found: ID does not exist"
Sep 10 15:39:35.778909 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.777566    2574 scope.go:117] "RemoveContainer" containerID="6273e49b7bd936729f85ef4d9dbd818c86b5b3326e35418475ea2aa914eb7dd1"
Sep 10 15:39:35.778909 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:39:35.777845    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6273e49b7bd936729f85ef4d9dbd818c86b5b3326e35418475ea2aa914eb7dd1\": container with ID starting with 6273e49b7bd936729f85ef4d9dbd818c86b5b3326e35418475ea2aa914eb7dd1 not found: ID does not exist" containerID="6273e49b7bd936729f85ef4d9dbd818c86b5b3326e35418475ea2aa914eb7dd1"
Sep 10 15:39:35.778909 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.777869    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6273e49b7bd936729f85ef4d9dbd818c86b5b3326e35418475ea2aa914eb7dd1"} err="failed to get container status \"6273e49b7bd936729f85ef4d9dbd818c86b5b3326e35418475ea2aa914eb7dd1\": rpc error: code = NotFound desc = could not find container \"6273e49b7bd936729f85ef4d9dbd818c86b5b3326e35418475ea2aa914eb7dd1\": container with ID starting with 6273e49b7bd936729f85ef4d9dbd818c86b5b3326e35418475ea2aa914eb7dd1 not found: ID does not exist"
Sep 10 15:39:35.778909 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.777889    2574 scope.go:117] "RemoveContainer" containerID="795dfba8af0bd8edc82c1daf3d9d47f6ad7555ebf00a9093b8fee1b44eede8ef"
Sep 10 15:39:35.781119 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.781099    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"]
Sep 10 15:39:35.783733 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.783711    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-dd499d-openshift-default-6cfd65c6c6-cpwmt"]
Sep 10 15:39:35.787628 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.787615    2574 scope.go:117] "RemoveContainer" containerID="795dfba8af0bd8edc82c1daf3d9d47f6ad7555ebf00a9093b8fee1b44eede8ef"
Sep 10 15:39:35.787872 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:39:35.787852    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"795dfba8af0bd8edc82c1daf3d9d47f6ad7555ebf00a9093b8fee1b44eede8ef\": container with ID starting with 795dfba8af0bd8edc82c1daf3d9d47f6ad7555ebf00a9093b8fee1b44eede8ef not found: ID does not exist" containerID="795dfba8af0bd8edc82c1daf3d9d47f6ad7555ebf00a9093b8fee1b44eede8ef"
Sep 10 15:39:35.787959 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:35.787881    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"795dfba8af0bd8edc82c1daf3d9d47f6ad7555ebf00a9093b8fee1b44eede8ef"} err="failed to get container status \"795dfba8af0bd8edc82c1daf3d9d47f6ad7555ebf00a9093b8fee1b44eede8ef\": rpc error: code = NotFound desc = could not find container \"795dfba8af0bd8edc82c1daf3d9d47f6ad7555ebf00a9093b8fee1b44eede8ef\": container with ID starting with 795dfba8af0bd8edc82c1daf3d9d47f6ad7555ebf00a9093b8fee1b44eede8ef not found: ID does not exist"
Sep 10 15:39:37.411023 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:37.410987    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a35856a5-eb3a-41d5-9a1a-9b703faa63b6" path="/var/lib/kubelet/pods/a35856a5-eb3a-41d5-9a1a-9b703faa63b6/volumes"
Sep 10 15:39:45.784901 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:45.784814    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"]
Sep 10 15:39:45.785350 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:45.785058    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr" podUID="a9ac01f6-7fa4-42b1-b446-00b790498e8d" containerName="maas-api" containerID="cri-o://1ed7bf74917a20960e67586ab7ed5cf74225e59f7a9184d6d6cac6fdf1fa04ce" gracePeriod=30
Sep 10 15:39:46.038619 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.038541    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"
Sep 10 15:39:46.119573 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.119538    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9ac01f6-7fa4-42b1-b446-00b790498e8d-maas-api-tls\") pod \"a9ac01f6-7fa4-42b1-b446-00b790498e8d\" (UID: \"a9ac01f6-7fa4-42b1-b446-00b790498e8d\") "
Sep 10 15:39:46.119753 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.119660    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5ds9\" (UniqueName: \"kubernetes.io/projected/a9ac01f6-7fa4-42b1-b446-00b790498e8d-kube-api-access-l5ds9\") pod \"a9ac01f6-7fa4-42b1-b446-00b790498e8d\" (UID: \"a9ac01f6-7fa4-42b1-b446-00b790498e8d\") "
Sep 10 15:39:46.119753 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.119701    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9ac01f6-7fa4-42b1-b446-00b790498e8d-metrics-certs\") pod \"a9ac01f6-7fa4-42b1-b446-00b790498e8d\" (UID: \"a9ac01f6-7fa4-42b1-b446-00b790498e8d\") "
Sep 10 15:39:46.119878 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.119799    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9ac01f6-7fa4-42b1-b446-00b790498e8d-openshift-service-ca\") pod \"a9ac01f6-7fa4-42b1-b446-00b790498e8d\" (UID: \"a9ac01f6-7fa4-42b1-b446-00b790498e8d\") "
Sep 10 15:39:46.120318 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.120280    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9ac01f6-7fa4-42b1-b446-00b790498e8d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a9ac01f6-7fa4-42b1-b446-00b790498e8d" (UID: "a9ac01f6-7fa4-42b1-b446-00b790498e8d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:39:46.122357 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.122316    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9ac01f6-7fa4-42b1-b446-00b790498e8d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a9ac01f6-7fa4-42b1-b446-00b790498e8d" (UID: "a9ac01f6-7fa4-42b1-b446-00b790498e8d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:39:46.122460 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.122389    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9ac01f6-7fa4-42b1-b446-00b790498e8d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a9ac01f6-7fa4-42b1-b446-00b790498e8d" (UID: "a9ac01f6-7fa4-42b1-b446-00b790498e8d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:39:46.122460 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.122409    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9ac01f6-7fa4-42b1-b446-00b790498e8d-kube-api-access-l5ds9" (OuterVolumeSpecName: "kube-api-access-l5ds9") pod "a9ac01f6-7fa4-42b1-b446-00b790498e8d" (UID: "a9ac01f6-7fa4-42b1-b446-00b790498e8d"). InnerVolumeSpecName "kube-api-access-l5ds9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:39:46.220781 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.220742    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9ac01f6-7fa4-42b1-b446-00b790498e8d-openshift-service-ca\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:46.220781 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.220775    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9ac01f6-7fa4-42b1-b446-00b790498e8d-maas-api-tls\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:46.220781 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.220784    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5ds9\" (UniqueName: \"kubernetes.io/projected/a9ac01f6-7fa4-42b1-b446-00b790498e8d-kube-api-access-l5ds9\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:46.221069 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.220793    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9ac01f6-7fa4-42b1-b446-00b790498e8d-metrics-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:46.824589 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.824551    2574 generic.go:356] "Generic (PLEG): container finished" podID="a9ac01f6-7fa4-42b1-b446-00b790498e8d" containerID="1ed7bf74917a20960e67586ab7ed5cf74225e59f7a9184d6d6cac6fdf1fa04ce" exitCode=0
Sep 10 15:39:46.825012 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.824599    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"
Sep 10 15:39:46.825012 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.824640    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr" event={"ID":"a9ac01f6-7fa4-42b1-b446-00b790498e8d","Type":"ContainerDied","Data":"1ed7bf74917a20960e67586ab7ed5cf74225e59f7a9184d6d6cac6fdf1fa04ce"}
Sep 10 15:39:46.825012 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.824692    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr" event={"ID":"a9ac01f6-7fa4-42b1-b446-00b790498e8d","Type":"ContainerDied","Data":"e78ca723fcd96d70ea269eea5cea747d418adb94a4ac049a1068c9e6fa4aa1a4"}
Sep 10 15:39:46.825012 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.824716    2574 scope.go:117] "RemoveContainer" containerID="1ed7bf74917a20960e67586ab7ed5cf74225e59f7a9184d6d6cac6fdf1fa04ce"
Sep 10 15:39:46.834876 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.834857    2574 scope.go:117] "RemoveContainer" containerID="1ed7bf74917a20960e67586ab7ed5cf74225e59f7a9184d6d6cac6fdf1fa04ce"
Sep 10 15:39:46.835181 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:39:46.835159    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ed7bf74917a20960e67586ab7ed5cf74225e59f7a9184d6d6cac6fdf1fa04ce\": container with ID starting with 1ed7bf74917a20960e67586ab7ed5cf74225e59f7a9184d6d6cac6fdf1fa04ce not found: ID does not exist" containerID="1ed7bf74917a20960e67586ab7ed5cf74225e59f7a9184d6d6cac6fdf1fa04ce"
Sep 10 15:39:46.835259 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.835189    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ed7bf74917a20960e67586ab7ed5cf74225e59f7a9184d6d6cac6fdf1fa04ce"} err="failed to get container status \"1ed7bf74917a20960e67586ab7ed5cf74225e59f7a9184d6d6cac6fdf1fa04ce\": rpc error: code = NotFound desc = could not find container \"1ed7bf74917a20960e67586ab7ed5cf74225e59f7a9184d6d6cac6fdf1fa04ce\": container with ID starting with 1ed7bf74917a20960e67586ab7ed5cf74225e59f7a9184d6d6cac6fdf1fa04ce not found: ID does not exist"
Sep 10 15:39:46.847006 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.846983    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"]
Sep 10 15:39:46.851027 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:46.851008    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bbc967-7ff5b54bc6-fh7sr"]
Sep 10 15:39:47.409456 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:47.409426    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9ac01f6-7fa4-42b1-b446-00b790498e8d" path="/var/lib/kubelet/pods/a9ac01f6-7fa4-42b1-b446-00b790498e8d/volumes"
Sep 10 15:39:52.869109 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:52.869073    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"]
Sep 10 15:39:52.870055 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:52.870000    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx" podUID="1b109cc5-a589-4598-aaca-271da0eaa404" containerName="istio-proxy" containerID="cri-o://702fd370a9ca4d01e31553e9ac2ce79688f008484cd92a8dc3ca45947d327337" gracePeriod=30
Sep 10 15:39:53.208301 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.208220    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5fe45b-mt7hv"]
Sep 10 15:39:53.208603 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.208590    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b6cf8a0-4505-49db-a513-ca93fc5992f8" containerName="test-curl-7824-bb27dd"
Sep 10 15:39:53.208648 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.208605    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b6cf8a0-4505-49db-a513-ca93fc5992f8" containerName="test-curl-7824-bb27dd"
Sep 10 15:39:53.208648 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.208618    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9ac01f6-7fa4-42b1-b446-00b790498e8d" containerName="maas-api"
Sep 10 15:39:53.208648 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.208624    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9ac01f6-7fa4-42b1-b446-00b790498e8d" containerName="maas-api"
Sep 10 15:39:53.208648 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.208638    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a35856a5-eb3a-41d5-9a1a-9b703faa63b6" containerName="istio-proxy"
Sep 10 15:39:53.208648 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.208643    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a35856a5-eb3a-41d5-9a1a-9b703faa63b6" containerName="istio-proxy"
Sep 10 15:39:53.208648 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.208650    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a35856a5-eb3a-41d5-9a1a-9b703faa63b6" containerName="istio-proxy"
Sep 10 15:39:53.208829 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.208655    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a35856a5-eb3a-41d5-9a1a-9b703faa63b6" containerName="istio-proxy"
Sep 10 15:39:53.208829 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.208717    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9ac01f6-7fa4-42b1-b446-00b790498e8d" containerName="maas-api"
Sep 10 15:39:53.208829 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.208724    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b6cf8a0-4505-49db-a513-ca93fc5992f8" containerName="test-curl-7824-bb27dd"
Sep 10 15:39:53.208829 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.208730    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a35856a5-eb3a-41d5-9a1a-9b703faa63b6" containerName="istio-proxy"
Sep 10 15:39:53.208829 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.208735    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a35856a5-eb3a-41d5-9a1a-9b703faa63b6" containerName="istio-proxy"
Sep 10 15:39:53.213426 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.213410    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5fe45b-mt7hv"
Sep 10 15:39:53.216208 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.216181    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 15:39:53.216505 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.216396    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zzl2g\""
Sep 10 15:39:53.220197 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.220171    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5fe45b-mt7hv"]
Sep 10 15:39:53.289884 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.289852    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e7abc62-3497-4afa-9553-dcc025ec028b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-5fe45b-mt7hv\" (UID: \"1e7abc62-3497-4afa-9553-dcc025ec028b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5fe45b-mt7hv"
Sep 10 15:39:53.391503 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.391467    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e7abc62-3497-4afa-9553-dcc025ec028b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-5fe45b-mt7hv\" (UID: \"1e7abc62-3497-4afa-9553-dcc025ec028b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5fe45b-mt7hv"
Sep 10 15:39:53.392169 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.392145    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e7abc62-3497-4afa-9553-dcc025ec028b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-5fe45b-mt7hv\" (UID: \"1e7abc62-3497-4afa-9553-dcc025ec028b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5fe45b-mt7hv"
Sep 10 15:39:53.525491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.525392    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5fe45b-mt7hv"
Sep 10 15:39:53.805921 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.805887    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5fe45b-mt7hv"]
Sep 10 15:39:53.807158 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:39:53.807131    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e7abc62_3497_4afa_9553_dcc025ec028b.slice/crio-7501876e2b74400d3d0ea9985725faac04dddd5c1a514b8c311c5e678d21e5af WatchSource:0}: Error finding container 7501876e2b74400d3d0ea9985725faac04dddd5c1a514b8c311c5e678d21e5af: Status 404 returned error can't find the container with id 7501876e2b74400d3d0ea9985725faac04dddd5c1a514b8c311c5e678d21e5af
Sep 10 15:39:53.882441 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:53.882409    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5fe45b-mt7hv" event={"ID":"1e7abc62-3497-4afa-9553-dcc025ec028b","Type":"ContainerStarted","Data":"7501876e2b74400d3d0ea9985725faac04dddd5c1a514b8c311c5e678d21e5af"}
Sep 10 15:39:54.891344 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:54.891252    2574 generic.go:356] "Generic (PLEG): container finished" podID="1e7abc62-3497-4afa-9553-dcc025ec028b" containerID="48b249518465f43329d774006e69e471a76aece0e7a76c102e8e9ca590e91e39" exitCode=0
Sep 10 15:39:54.891704 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:54.891340    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5fe45b-mt7hv" event={"ID":"1e7abc62-3497-4afa-9553-dcc025ec028b","Type":"ContainerDied","Data":"48b249518465f43329d774006e69e471a76aece0e7a76c102e8e9ca590e91e39"}
Sep 10 15:39:56.031539 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:56.031513    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5fe45b-mt7hv"
Sep 10 15:39:56.122501 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:56.122468    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e7abc62-3497-4afa-9553-dcc025ec028b-maas-api-service-ca\") pod \"1e7abc62-3497-4afa-9553-dcc025ec028b\" (UID: \"1e7abc62-3497-4afa-9553-dcc025ec028b\") "
Sep 10 15:39:56.122826 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:56.122803    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e7abc62-3497-4afa-9553-dcc025ec028b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1e7abc62-3497-4afa-9553-dcc025ec028b" (UID: "1e7abc62-3497-4afa-9553-dcc025ec028b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:39:56.223642 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:56.223553    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e7abc62-3497-4afa-9553-dcc025ec028b-maas-api-service-ca\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:56.904854 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:56.904821    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5fe45b-mt7hv" event={"ID":"1e7abc62-3497-4afa-9553-dcc025ec028b","Type":"ContainerDied","Data":"7501876e2b74400d3d0ea9985725faac04dddd5c1a514b8c311c5e678d21e5af"}
Sep 10 15:39:56.904854 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:56.904870    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7501876e2b74400d3d0ea9985725faac04dddd5c1a514b8c311c5e678d21e5af"
Sep 10 15:39:56.905092 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:56.904838    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5fe45b-mt7hv"
Sep 10 15:39:58.129125 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.129098    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:39:58.247298 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.247201    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b109cc5-a589-4598-aaca-271da0eaa404-istio-token\") pod \"1b109cc5-a589-4598-aaca-271da0eaa404\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") "
Sep 10 15:39:58.247298 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.247237    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-istio-envoy\") pod \"1b109cc5-a589-4598-aaca-271da0eaa404\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") "
Sep 10 15:39:58.247298 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.247256    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b109cc5-a589-4598-aaca-271da0eaa404-istiod-ca-cert\") pod \"1b109cc5-a589-4598-aaca-271da0eaa404\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") "
Sep 10 15:39:58.247298 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.247281    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-workload-socket\") pod \"1b109cc5-a589-4598-aaca-271da0eaa404\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") "
Sep 10 15:39:58.247626 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.247305    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b109cc5-a589-4598-aaca-271da0eaa404-istio-podinfo\") pod \"1b109cc5-a589-4598-aaca-271da0eaa404\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") "
Sep 10 15:39:58.247626 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.247368    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v4zv\" (UniqueName: \"kubernetes.io/projected/1b109cc5-a589-4598-aaca-271da0eaa404-kube-api-access-4v4zv\") pod \"1b109cc5-a589-4598-aaca-271da0eaa404\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") "
Sep 10 15:39:58.247626 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.247427    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-istio-data\") pod \"1b109cc5-a589-4598-aaca-271da0eaa404\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") "
Sep 10 15:39:58.247626 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.247459    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-credential-socket\") pod \"1b109cc5-a589-4598-aaca-271da0eaa404\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") "
Sep 10 15:39:58.247626 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.247535    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-workload-certs\") pod \"1b109cc5-a589-4598-aaca-271da0eaa404\" (UID: \"1b109cc5-a589-4598-aaca-271da0eaa404\") "
Sep 10 15:39:58.247626 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.247599    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1b109cc5-a589-4598-aaca-271da0eaa404" (UID: "1b109cc5-a589-4598-aaca-271da0eaa404"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:39:58.247977 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.247703    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b109cc5-a589-4598-aaca-271da0eaa404-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1b109cc5-a589-4598-aaca-271da0eaa404" (UID: "1b109cc5-a589-4598-aaca-271da0eaa404"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:39:58.247977 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.247826    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1b109cc5-a589-4598-aaca-271da0eaa404" (UID: "1b109cc5-a589-4598-aaca-271da0eaa404"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:39:58.247977 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.247915    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-istio-data" (OuterVolumeSpecName: "istio-data") pod "1b109cc5-a589-4598-aaca-271da0eaa404" (UID: "1b109cc5-a589-4598-aaca-271da0eaa404"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:39:58.248158 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.248065    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1b109cc5-a589-4598-aaca-271da0eaa404" (UID: "1b109cc5-a589-4598-aaca-271da0eaa404"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:39:58.248216 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.248166    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-workload-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:58.248216 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.248186    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b109cc5-a589-4598-aaca-271da0eaa404-istiod-ca-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:58.248216 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.248199    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-workload-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:58.248216 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.248211    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-istio-data\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:58.249583 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.249550    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b109cc5-a589-4598-aaca-271da0eaa404-istio-token" (OuterVolumeSpecName: "istio-token") pod "1b109cc5-a589-4598-aaca-271da0eaa404" (UID: "1b109cc5-a589-4598-aaca-271da0eaa404"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:39:58.249694 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.249598    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1b109cc5-a589-4598-aaca-271da0eaa404" (UID: "1b109cc5-a589-4598-aaca-271da0eaa404"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:39:58.249694 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.249599    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1b109cc5-a589-4598-aaca-271da0eaa404-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1b109cc5-a589-4598-aaca-271da0eaa404" (UID: "1b109cc5-a589-4598-aaca-271da0eaa404"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:39:58.249694 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.249636    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b109cc5-a589-4598-aaca-271da0eaa404-kube-api-access-4v4zv" (OuterVolumeSpecName: "kube-api-access-4v4zv") pod "1b109cc5-a589-4598-aaca-271da0eaa404" (UID: "1b109cc5-a589-4598-aaca-271da0eaa404"). InnerVolumeSpecName "kube-api-access-4v4zv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:39:58.349432 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.349393    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v4zv\" (UniqueName: \"kubernetes.io/projected/1b109cc5-a589-4598-aaca-271da0eaa404-kube-api-access-4v4zv\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:58.349432 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.349424    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-credential-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:58.349432 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.349434    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b109cc5-a589-4598-aaca-271da0eaa404-istio-token\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:58.349432 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.349443    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b109cc5-a589-4598-aaca-271da0eaa404-istio-envoy\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:58.349700 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.349451    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b109cc5-a589-4598-aaca-271da0eaa404-istio-podinfo\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:39:58.918603 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.918568    2574 generic.go:356] "Generic (PLEG): container finished" podID="1b109cc5-a589-4598-aaca-271da0eaa404" containerID="702fd370a9ca4d01e31553e9ac2ce79688f008484cd92a8dc3ca45947d327337" exitCode=0
Sep 10 15:39:58.918783 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.918615    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"
Sep 10 15:39:58.918783 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.918652    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx" event={"ID":"1b109cc5-a589-4598-aaca-271da0eaa404","Type":"ContainerDied","Data":"702fd370a9ca4d01e31553e9ac2ce79688f008484cd92a8dc3ca45947d327337"}
Sep 10 15:39:58.918783 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.918706    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx" event={"ID":"1b109cc5-a589-4598-aaca-271da0eaa404","Type":"ContainerDied","Data":"f22063d333e2057dd333d88350effec1913e5fb090cb21dd449b73825bf7683e"}
Sep 10 15:39:58.918783 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.918729    2574 scope.go:117] "RemoveContainer" containerID="702fd370a9ca4d01e31553e9ac2ce79688f008484cd92a8dc3ca45947d327337"
Sep 10 15:39:58.928393 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.928379    2574 scope.go:117] "RemoveContainer" containerID="6ccb49121969844d55cc596aacc5abe51643a2d04941699c66dab49fe71df728"
Sep 10 15:39:58.936453 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.936436    2574 scope.go:117] "RemoveContainer" containerID="702fd370a9ca4d01e31553e9ac2ce79688f008484cd92a8dc3ca45947d327337"
Sep 10 15:39:58.936716 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:39:58.936696    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"702fd370a9ca4d01e31553e9ac2ce79688f008484cd92a8dc3ca45947d327337\": container with ID starting with 702fd370a9ca4d01e31553e9ac2ce79688f008484cd92a8dc3ca45947d327337 not found: ID does not exist" containerID="702fd370a9ca4d01e31553e9ac2ce79688f008484cd92a8dc3ca45947d327337"
Sep 10 15:39:58.936792 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.936727    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"702fd370a9ca4d01e31553e9ac2ce79688f008484cd92a8dc3ca45947d327337"} err="failed to get container status \"702fd370a9ca4d01e31553e9ac2ce79688f008484cd92a8dc3ca45947d327337\": rpc error: code = NotFound desc = could not find container \"702fd370a9ca4d01e31553e9ac2ce79688f008484cd92a8dc3ca45947d327337\": container with ID starting with 702fd370a9ca4d01e31553e9ac2ce79688f008484cd92a8dc3ca45947d327337 not found: ID does not exist"
Sep 10 15:39:58.936792 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.936750    2574 scope.go:117] "RemoveContainer" containerID="6ccb49121969844d55cc596aacc5abe51643a2d04941699c66dab49fe71df728"
Sep 10 15:39:58.937061 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:39:58.937042    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ccb49121969844d55cc596aacc5abe51643a2d04941699c66dab49fe71df728\": container with ID starting with 6ccb49121969844d55cc596aacc5abe51643a2d04941699c66dab49fe71df728 not found: ID does not exist" containerID="6ccb49121969844d55cc596aacc5abe51643a2d04941699c66dab49fe71df728"
Sep 10 15:39:58.937101 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.937067    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ccb49121969844d55cc596aacc5abe51643a2d04941699c66dab49fe71df728"} err="failed to get container status \"6ccb49121969844d55cc596aacc5abe51643a2d04941699c66dab49fe71df728\": rpc error: code = NotFound desc = could not find container \"6ccb49121969844d55cc596aacc5abe51643a2d04941699c66dab49fe71df728\": container with ID starting with 6ccb49121969844d55cc596aacc5abe51643a2d04941699c66dab49fe71df728 not found: ID does not exist"
Sep 10 15:39:58.943635 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.943614    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"]
Sep 10 15:39:58.949284 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:58.949261    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-bbc967-openshift-default-7fcb67675b-nn8gx"]
Sep 10 15:39:59.410114 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:39:59.410084    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b109cc5-a589-4598-aaca-271da0eaa404" path="/var/lib/kubelet/pods/1b109cc5-a589-4598-aaca-271da0eaa404/volumes"
Sep 10 15:40:03.933513 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:03.933481    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5fe45b-mt7hv"]
Sep 10 15:40:03.935738 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:03.935717    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5fe45b-mt7hv"]
Sep 10 15:40:05.410352 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:05.410318    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e7abc62-3497-4afa-9553-dcc025ec028b" path="/var/lib/kubelet/pods/1e7abc62-3497-4afa-9553-dcc025ec028b/volumes"
Sep 10 15:40:10.656377 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:10.656344    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"]
Sep 10 15:40:10.656845 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:10.656643    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt" podUID="4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" containerName="istio-proxy" containerID="cri-o://ebcac3088f4e463b20d92ae7cbfcfd3bc87f7da461486a18441abd2ac2406820" gracePeriod=30
Sep 10 15:40:10.999321 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:10.999241    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d7a2b3-mtq46"]
Sep 10 15:40:10.999632 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:10.999610    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e7abc62-3497-4afa-9553-dcc025ec028b" containerName="revoke-keys"
Sep 10 15:40:10.999632 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:10.999626    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e7abc62-3497-4afa-9553-dcc025ec028b" containerName="revoke-keys"
Sep 10 15:40:10.999632 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:10.999636    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b109cc5-a589-4598-aaca-271da0eaa404" containerName="istio-proxy"
Sep 10 15:40:10.999829 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:10.999642    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b109cc5-a589-4598-aaca-271da0eaa404" containerName="istio-proxy"
Sep 10 15:40:10.999829 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:10.999663    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b109cc5-a589-4598-aaca-271da0eaa404" containerName="istio-proxy"
Sep 10 15:40:10.999829 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:10.999669    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b109cc5-a589-4598-aaca-271da0eaa404" containerName="istio-proxy"
Sep 10 15:40:10.999829 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:10.999732    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b109cc5-a589-4598-aaca-271da0eaa404" containerName="istio-proxy"
Sep 10 15:40:10.999829 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:10.999741    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b109cc5-a589-4598-aaca-271da0eaa404" containerName="istio-proxy"
Sep 10 15:40:10.999829 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:10.999747    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e7abc62-3497-4afa-9553-dcc025ec028b" containerName="revoke-keys"
Sep 10 15:40:11.004638 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:11.004620    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d7a2b3-mtq46"
Sep 10 15:40:11.007377 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:11.007356    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zzl2g\""
Sep 10 15:40:11.007538 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:11.007507    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 15:40:11.013302 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:11.013278    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d7a2b3-mtq46"]
Sep 10 15:40:11.073141 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:11.073099    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5035cda5-c9f1-4815-91ba-ac4a195adbfc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-d7a2b3-mtq46\" (UID: \"5035cda5-c9f1-4815-91ba-ac4a195adbfc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d7a2b3-mtq46"
Sep 10 15:40:11.173751 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:11.173714    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5035cda5-c9f1-4815-91ba-ac4a195adbfc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-d7a2b3-mtq46\" (UID: \"5035cda5-c9f1-4815-91ba-ac4a195adbfc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d7a2b3-mtq46"
Sep 10 15:40:11.174445 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:11.174425    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5035cda5-c9f1-4815-91ba-ac4a195adbfc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-d7a2b3-mtq46\" (UID: \"5035cda5-c9f1-4815-91ba-ac4a195adbfc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d7a2b3-mtq46"
Sep 10 15:40:11.317797 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:11.317767    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d7a2b3-mtq46"
Sep 10 15:40:11.591283 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:11.591252    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d7a2b3-mtq46"]
Sep 10 15:40:11.592710 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:40:11.592674    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5035cda5_c9f1_4815_91ba_ac4a195adbfc.slice/crio-f3b212c935c3b4bd3df200dbfd31f9e0b61e634baab6abc2b48cb4910d37a004 WatchSource:0}: Error finding container f3b212c935c3b4bd3df200dbfd31f9e0b61e634baab6abc2b48cb4910d37a004: Status 404 returned error can't find the container with id f3b212c935c3b4bd3df200dbfd31f9e0b61e634baab6abc2b48cb4910d37a004
Sep 10 15:40:11.997851 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:11.997813    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d7a2b3-mtq46" event={"ID":"5035cda5-c9f1-4815-91ba-ac4a195adbfc","Type":"ContainerStarted","Data":"5d3370978af4a0a78a262f59a7ee78a0a0835784c83d538f26de23aa9b9b9fa1"}
Sep 10 15:40:11.998241 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:11.997875    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d7a2b3-mtq46" event={"ID":"5035cda5-c9f1-4815-91ba-ac4a195adbfc","Type":"ContainerStarted","Data":"f3b212c935c3b4bd3df200dbfd31f9e0b61e634baab6abc2b48cb4910d37a004"}
Sep 10 15:40:12.016573 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:12.016526    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d7a2b3-mtq46" podStartSLOduration=2.016509349 podStartE2EDuration="2.016509349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:40:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:40:12.013679547 +0000 UTC m=+1465.063478056" watchObservedRunningTime="2026-09-10 15:40:12.016509349 +0000 UTC m=+1465.066307856"
Sep 10 15:40:13.005289 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:13.005254    2574 generic.go:356] "Generic (PLEG): container finished" podID="5035cda5-c9f1-4815-91ba-ac4a195adbfc" containerID="5d3370978af4a0a78a262f59a7ee78a0a0835784c83d538f26de23aa9b9b9fa1" exitCode=0
Sep 10 15:40:13.005676 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:13.005336    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d7a2b3-mtq46" event={"ID":"5035cda5-c9f1-4815-91ba-ac4a195adbfc","Type":"ContainerDied","Data":"5d3370978af4a0a78a262f59a7ee78a0a0835784c83d538f26de23aa9b9b9fa1"}
Sep 10 15:40:14.150164 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:14.150137    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d7a2b3-mtq46"
Sep 10 15:40:14.206704 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:14.206670    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5035cda5-c9f1-4815-91ba-ac4a195adbfc-maas-api-service-ca\") pod \"5035cda5-c9f1-4815-91ba-ac4a195adbfc\" (UID: \"5035cda5-c9f1-4815-91ba-ac4a195adbfc\") "
Sep 10 15:40:14.207094 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:14.207064    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5035cda5-c9f1-4815-91ba-ac4a195adbfc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5035cda5-c9f1-4815-91ba-ac4a195adbfc" (UID: "5035cda5-c9f1-4815-91ba-ac4a195adbfc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:40:14.307507 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:14.307471    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5035cda5-c9f1-4815-91ba-ac4a195adbfc-maas-api-service-ca\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:40:15.017660 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:15.017631    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d7a2b3-mtq46"
Sep 10 15:40:15.017869 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:15.017692    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d7a2b3-mtq46" event={"ID":"5035cda5-c9f1-4815-91ba-ac4a195adbfc","Type":"ContainerDied","Data":"f3b212c935c3b4bd3df200dbfd31f9e0b61e634baab6abc2b48cb4910d37a004"}
Sep 10 15:40:15.017869 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:15.017742    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3b212c935c3b4bd3df200dbfd31f9e0b61e634baab6abc2b48cb4910d37a004"
Sep 10 15:40:15.907788 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:15.907763    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:40:16.024021 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.023903    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-workload-socket\") pod \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") "
Sep 10 15:40:16.024021 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.023983    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-data\") pod \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") "
Sep 10 15:40:16.024021 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.024011    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-podinfo\") pod \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") "
Sep 10 15:40:16.024317 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.024037    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-credential-socket\") pod \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") "
Sep 10 15:40:16.024317 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.024071    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-workload-certs\") pod \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") "
Sep 10 15:40:16.024317 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.024102    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rws5z\" (UniqueName: \"kubernetes.io/projected/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-kube-api-access-rws5z\") pod \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") "
Sep 10 15:40:16.024317 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.024135    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istiod-ca-cert\") pod \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") "
Sep 10 15:40:16.024317 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.024155    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-envoy\") pod \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") "
Sep 10 15:40:16.024317 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.024179    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-token\") pod \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\" (UID: \"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a\") "
Sep 10 15:40:16.024317 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.024227    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" (UID: "4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:40:16.024667 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.024348    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-data" (OuterVolumeSpecName: "istio-data") pod "4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" (UID: "4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:40:16.024667 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.024397    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" (UID: "4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:40:16.024667 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.024412    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" (UID: "4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:40:16.024667 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.024583    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-workload-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:40:16.024667 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.024602    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-data\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:40:16.024667 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.024616    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-credential-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:40:16.024667 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.024614    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" (UID: "4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:40:16.024667 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.024630    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-workload-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:40:16.026481 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.026452    2574 generic.go:356] "Generic (PLEG): container finished" podID="4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" containerID="ebcac3088f4e463b20d92ae7cbfcfd3bc87f7da461486a18441abd2ac2406820" exitCode=0
Sep 10 15:40:16.026609 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.026513    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"
Sep 10 15:40:16.026609 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.026540    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt" event={"ID":"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a","Type":"ContainerDied","Data":"ebcac3088f4e463b20d92ae7cbfcfd3bc87f7da461486a18441abd2ac2406820"}
Sep 10 15:40:16.026609 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.026598    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt" event={"ID":"4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a","Type":"ContainerDied","Data":"6e967bb1bec660cdbac48ce5f02f01ae4586334586a33a370cb6ee26f7a581d7"}
Sep 10 15:40:16.026766 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.026626    2574 scope.go:117] "RemoveContainer" containerID="ebcac3088f4e463b20d92ae7cbfcfd3bc87f7da461486a18441abd2ac2406820"
Sep 10 15:40:16.027063 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.027039    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" (UID: "4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:40:16.027063 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.027050    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-kube-api-access-rws5z" (OuterVolumeSpecName: "kube-api-access-rws5z") pod "4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" (UID: "4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a"). InnerVolumeSpecName "kube-api-access-rws5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:40:16.027063 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.027058    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" (UID: "4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:40:16.027250 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.027071    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-token" (OuterVolumeSpecName: "istio-token") pod "4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" (UID: "4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:40:16.045972 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.045944    2574 scope.go:117] "RemoveContainer" containerID="13c0f2bdc428ca70f4276252c4391e79b0878448412e32c6bd27fdf58e59b936"
Sep 10 15:40:16.054445 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.054427    2574 scope.go:117] "RemoveContainer" containerID="ebcac3088f4e463b20d92ae7cbfcfd3bc87f7da461486a18441abd2ac2406820"
Sep 10 15:40:16.054725 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:40:16.054697    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebcac3088f4e463b20d92ae7cbfcfd3bc87f7da461486a18441abd2ac2406820\": container with ID starting with ebcac3088f4e463b20d92ae7cbfcfd3bc87f7da461486a18441abd2ac2406820 not found: ID does not exist" containerID="ebcac3088f4e463b20d92ae7cbfcfd3bc87f7da461486a18441abd2ac2406820"
Sep 10 15:40:16.054775 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.054733    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebcac3088f4e463b20d92ae7cbfcfd3bc87f7da461486a18441abd2ac2406820"} err="failed to get container status \"ebcac3088f4e463b20d92ae7cbfcfd3bc87f7da461486a18441abd2ac2406820\": rpc error: code = NotFound desc = could not find container \"ebcac3088f4e463b20d92ae7cbfcfd3bc87f7da461486a18441abd2ac2406820\": container with ID starting with ebcac3088f4e463b20d92ae7cbfcfd3bc87f7da461486a18441abd2ac2406820 not found: ID does not exist"
Sep 10 15:40:16.054775 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.054751    2574 scope.go:117] "RemoveContainer" containerID="13c0f2bdc428ca70f4276252c4391e79b0878448412e32c6bd27fdf58e59b936"
Sep 10 15:40:16.055057 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:40:16.055039    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13c0f2bdc428ca70f4276252c4391e79b0878448412e32c6bd27fdf58e59b936\": container with ID starting with 13c0f2bdc428ca70f4276252c4391e79b0878448412e32c6bd27fdf58e59b936 not found: ID does not exist" containerID="13c0f2bdc428ca70f4276252c4391e79b0878448412e32c6bd27fdf58e59b936"
Sep 10 15:40:16.055111 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.055061    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13c0f2bdc428ca70f4276252c4391e79b0878448412e32c6bd27fdf58e59b936"} err="failed to get container status \"13c0f2bdc428ca70f4276252c4391e79b0878448412e32c6bd27fdf58e59b936\": rpc error: code = NotFound desc = could not find container \"13c0f2bdc428ca70f4276252c4391e79b0878448412e32c6bd27fdf58e59b936\": container with ID starting with 13c0f2bdc428ca70f4276252c4391e79b0878448412e32c6bd27fdf58e59b936 not found: ID does not exist"
Sep 10 15:40:16.126068 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.126035    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-token\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:40:16.126068 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.126061    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-podinfo\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:40:16.126068 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.126070    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rws5z\" (UniqueName: \"kubernetes.io/projected/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-kube-api-access-rws5z\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:40:16.126068 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.126079    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istiod-ca-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:40:16.126345 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.126088    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a-istio-envoy\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:40:16.350497 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.350462    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"]
Sep 10 15:40:16.356276 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:16.356251    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5fe45b-openshift-default-6d446c4884-4n7pt"]
Sep 10 15:40:17.408987 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:17.408957    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" path="/var/lib/kubelet/pods/4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a/volumes"
Sep 10 15:40:21.970674 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:21.970641    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d7a2b3-mtq46"]
Sep 10 15:40:21.972948 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:21.972913    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d7a2b3-mtq46"]
Sep 10 15:40:23.408729 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:23.408693    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5035cda5-c9f1-4815-91ba-ac4a195adbfc" path="/var/lib/kubelet/pods/5035cda5-c9f1-4815-91ba-ac4a195adbfc/volumes"
Sep 10 15:40:28.705978 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:28.705945    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"]
Sep 10 15:40:28.706473 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:28.706247    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd" podUID="b45c5ce1-75aa-48ce-95c3-3bb539f39964" containerName="istio-proxy" containerID="cri-o://f7890b6d117fc3c6dd69f2be6fb0174f68b8647db707d08f8a617ed2334d9adb" gracePeriod=30
Sep 10 15:40:33.966036 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:33.966006    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:40:34.109029 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.108997    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-envoy\") pod \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") "
Sep 10 15:40:34.109288 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.109098    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-data\") pod \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") "
Sep 10 15:40:34.109288 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.109141    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phkvr\" (UniqueName: \"kubernetes.io/projected/b45c5ce1-75aa-48ce-95c3-3bb539f39964-kube-api-access-phkvr\") pod \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") "
Sep 10 15:40:34.109288 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.109170    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-workload-certs\") pod \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") "
Sep 10 15:40:34.109288 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.109213    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istiod-ca-cert\") pod \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") "
Sep 10 15:40:34.109288 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.109245    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-token\") pod \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") "
Sep 10 15:40:34.109288 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.109273    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-podinfo\") pod \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") "
Sep 10 15:40:34.109642 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.109337    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-credential-socket\") pod \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") "
Sep 10 15:40:34.109642 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.109364    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-workload-socket\") pod \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\" (UID: \"b45c5ce1-75aa-48ce-95c3-3bb539f39964\") "
Sep 10 15:40:34.109642 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.109421    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-data" (OuterVolumeSpecName: "istio-data") pod "b45c5ce1-75aa-48ce-95c3-3bb539f39964" (UID: "b45c5ce1-75aa-48ce-95c3-3bb539f39964"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:40:34.109642 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.109604    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b45c5ce1-75aa-48ce-95c3-3bb539f39964" (UID: "b45c5ce1-75aa-48ce-95c3-3bb539f39964"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:40:34.109850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.109779    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-data\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:40:34.109850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.109797    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-workload-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:40:34.109850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.109834    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b45c5ce1-75aa-48ce-95c3-3bb539f39964" (UID: "b45c5ce1-75aa-48ce-95c3-3bb539f39964"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:40:34.110038 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.109962    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b45c5ce1-75aa-48ce-95c3-3bb539f39964" (UID: "b45c5ce1-75aa-48ce-95c3-3bb539f39964"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:40:34.110098 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.110041    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b45c5ce1-75aa-48ce-95c3-3bb539f39964" (UID: "b45c5ce1-75aa-48ce-95c3-3bb539f39964"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:40:34.111401 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.111378    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b45c5ce1-75aa-48ce-95c3-3bb539f39964" (UID: "b45c5ce1-75aa-48ce-95c3-3bb539f39964"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:40:34.111522 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.111439    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b45c5ce1-75aa-48ce-95c3-3bb539f39964" (UID: "b45c5ce1-75aa-48ce-95c3-3bb539f39964"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:40:34.111522 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.111472    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b45c5ce1-75aa-48ce-95c3-3bb539f39964-kube-api-access-phkvr" (OuterVolumeSpecName: "kube-api-access-phkvr") pod "b45c5ce1-75aa-48ce-95c3-3bb539f39964" (UID: "b45c5ce1-75aa-48ce-95c3-3bb539f39964"). InnerVolumeSpecName "kube-api-access-phkvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:40:34.111600 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.111543    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-token" (OuterVolumeSpecName: "istio-token") pod "b45c5ce1-75aa-48ce-95c3-3bb539f39964" (UID: "b45c5ce1-75aa-48ce-95c3-3bb539f39964"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:40:34.141119 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.141089    2574 generic.go:356] "Generic (PLEG): container finished" podID="b45c5ce1-75aa-48ce-95c3-3bb539f39964" containerID="f7890b6d117fc3c6dd69f2be6fb0174f68b8647db707d08f8a617ed2334d9adb" exitCode=0
Sep 10 15:40:34.141234 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.141146    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"
Sep 10 15:40:34.141234 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.141164    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd" event={"ID":"b45c5ce1-75aa-48ce-95c3-3bb539f39964","Type":"ContainerDied","Data":"f7890b6d117fc3c6dd69f2be6fb0174f68b8647db707d08f8a617ed2334d9adb"}
Sep 10 15:40:34.141234 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.141218    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd" event={"ID":"b45c5ce1-75aa-48ce-95c3-3bb539f39964","Type":"ContainerDied","Data":"0f4dee313c9fc3c8a80bf1732c26231d115745b334fcbf144726f6adcb2606cf"}
Sep 10 15:40:34.141334 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.141250    2574 scope.go:117] "RemoveContainer" containerID="f7890b6d117fc3c6dd69f2be6fb0174f68b8647db707d08f8a617ed2334d9adb"
Sep 10 15:40:34.150548 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.150532    2574 scope.go:117] "RemoveContainer" containerID="72c516b2dc397c0e4d707fe11580039b137048d759e3908410a1e4714e059a10"
Sep 10 15:40:34.158708 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.158690    2574 scope.go:117] "RemoveContainer" containerID="f7890b6d117fc3c6dd69f2be6fb0174f68b8647db707d08f8a617ed2334d9adb"
Sep 10 15:40:34.159003 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:40:34.158979    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7890b6d117fc3c6dd69f2be6fb0174f68b8647db707d08f8a617ed2334d9adb\": container with ID starting with f7890b6d117fc3c6dd69f2be6fb0174f68b8647db707d08f8a617ed2334d9adb not found: ID does not exist" containerID="f7890b6d117fc3c6dd69f2be6fb0174f68b8647db707d08f8a617ed2334d9adb"
Sep 10 15:40:34.159060 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.159012    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7890b6d117fc3c6dd69f2be6fb0174f68b8647db707d08f8a617ed2334d9adb"} err="failed to get container status \"f7890b6d117fc3c6dd69f2be6fb0174f68b8647db707d08f8a617ed2334d9adb\": rpc error: code = NotFound desc = could not find container \"f7890b6d117fc3c6dd69f2be6fb0174f68b8647db707d08f8a617ed2334d9adb\": container with ID starting with f7890b6d117fc3c6dd69f2be6fb0174f68b8647db707d08f8a617ed2334d9adb not found: ID does not exist"
Sep 10 15:40:34.159060 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.159030    2574 scope.go:117] "RemoveContainer" containerID="72c516b2dc397c0e4d707fe11580039b137048d759e3908410a1e4714e059a10"
Sep 10 15:40:34.159287 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:40:34.159268    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72c516b2dc397c0e4d707fe11580039b137048d759e3908410a1e4714e059a10\": container with ID starting with 72c516b2dc397c0e4d707fe11580039b137048d759e3908410a1e4714e059a10 not found: ID does not exist" containerID="72c516b2dc397c0e4d707fe11580039b137048d759e3908410a1e4714e059a10"
Sep 10 15:40:34.159324 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.159295    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72c516b2dc397c0e4d707fe11580039b137048d759e3908410a1e4714e059a10"} err="failed to get container status \"72c516b2dc397c0e4d707fe11580039b137048d759e3908410a1e4714e059a10\": rpc error: code = NotFound desc = could not find container \"72c516b2dc397c0e4d707fe11580039b137048d759e3908410a1e4714e059a10\": container with ID starting with 72c516b2dc397c0e4d707fe11580039b137048d759e3908410a1e4714e059a10 not found: ID does not exist"
Sep 10 15:40:34.164720 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.164699    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"]
Sep 10 15:40:34.169106 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.169086    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-d7a2b3-openshift-default-6d5d677b6-2rwjd"]
Sep 10 15:40:34.211256 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.211227    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-token\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:40:34.211256 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.211255    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-podinfo\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:40:34.211416 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.211264    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-credential-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:40:34.211416 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.211273    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-workload-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:40:34.211416 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.211282    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istio-envoy\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:40:34.211416 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.211290    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phkvr\" (UniqueName: \"kubernetes.io/projected/b45c5ce1-75aa-48ce-95c3-3bb539f39964-kube-api-access-phkvr\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:40:34.211416 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:34.211297    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b45c5ce1-75aa-48ce-95c3-3bb539f39964-istiod-ca-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:40:35.409800 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:35.409768    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b45c5ce1-75aa-48ce-95c3-3bb539f39964" path="/var/lib/kubelet/pods/b45c5ce1-75aa-48ce-95c3-3bb539f39964/volumes"
Sep 10 15:40:47.484348 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:47.484310    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/2.log"
Sep 10 15:40:47.490795 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:40:47.490773    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/2.log"
Sep 10 15:41:01.424916 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.424880    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"]
Sep 10 15:41:01.425345 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.425332    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45c5ce1-75aa-48ce-95c3-3bb539f39964" containerName="istio-proxy"
Sep 10 15:41:01.425394 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.425350    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45c5ce1-75aa-48ce-95c3-3bb539f39964" containerName="istio-proxy"
Sep 10 15:41:01.425394 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.425368    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" containerName="istio-proxy"
Sep 10 15:41:01.425394 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.425374    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" containerName="istio-proxy"
Sep 10 15:41:01.425394 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.425381    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45c5ce1-75aa-48ce-95c3-3bb539f39964" containerName="istio-proxy"
Sep 10 15:41:01.425394 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.425386    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45c5ce1-75aa-48ce-95c3-3bb539f39964" containerName="istio-proxy"
Sep 10 15:41:01.425548 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.425399    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5035cda5-c9f1-4815-91ba-ac4a195adbfc" containerName="revoke-keys"
Sep 10 15:41:01.425548 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.425404    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5035cda5-c9f1-4815-91ba-ac4a195adbfc" containerName="revoke-keys"
Sep 10 15:41:01.425548 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.425472    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5035cda5-c9f1-4815-91ba-ac4a195adbfc" containerName="revoke-keys"
Sep 10 15:41:01.425548 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.425481    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" containerName="istio-proxy"
Sep 10 15:41:01.425548 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.425488    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" containerName="istio-proxy"
Sep 10 15:41:01.425548 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.425494    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b45c5ce1-75aa-48ce-95c3-3bb539f39964" containerName="istio-proxy"
Sep 10 15:41:01.425548 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.425501    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b45c5ce1-75aa-48ce-95c3-3bb539f39964" containerName="istio-proxy"
Sep 10 15:41:01.430032 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.430009    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.432707 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.432679    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-ba5c7e-openshift-default-dockercfg-89nzs\""
Sep 10 15:41:01.440414 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.440390    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"]
Sep 10 15:41:01.572188 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.572155    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-token\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.572384 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.572198    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-workload-certs\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.572384 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.572216    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-envoy\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.572384 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.572277    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-workload-socket\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.572384 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.572340    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-podinfo\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.572619 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.572414    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08246df6-a688-48cf-8ff7-2fba5e44bc34-istiod-ca-cert\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.572619 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.572556    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd2qf\" (UniqueName: \"kubernetes.io/projected/08246df6-a688-48cf-8ff7-2fba5e44bc34-kube-api-access-qd2qf\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.572619 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.572592    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-credential-socket\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.572749 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.572617    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-data\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.674090 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.674049    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd2qf\" (UniqueName: \"kubernetes.io/projected/08246df6-a688-48cf-8ff7-2fba5e44bc34-kube-api-access-qd2qf\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.674090 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.674089    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-credential-socket\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.674366 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.674105    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-data\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.674366 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.674123    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-token\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.674366 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.674145    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-workload-certs\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.674366 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.674233    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-envoy\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.674366 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.674291    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-workload-socket\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.674366 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.674318    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-podinfo\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.674693 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.674383    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08246df6-a688-48cf-8ff7-2fba5e44bc34-istiod-ca-cert\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.674693 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.674544    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-workload-certs\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.674693 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.674615    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-data\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.674693 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.674683    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-credential-socket\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.674880 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.674741    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-workload-socket\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.675155 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.675091    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08246df6-a688-48cf-8ff7-2fba5e44bc34-istiod-ca-cert\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.676717 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.676693    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-envoy\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.677033 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.677014    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-podinfo\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.682878 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.682850    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-token\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.683096 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.683080    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd2qf\" (UniqueName: \"kubernetes.io/projected/08246df6-a688-48cf-8ff7-2fba5e44bc34-kube-api-access-qd2qf\") pod \"e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") " pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:01.743130 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:01.743093    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:02.024878 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:02.024845    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"]
Sep 10 15:41:02.030462 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:02.030429    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:41:02.030570 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:02.030494    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:41:02.030570 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:02.030526    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:41:02.299947 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:02.299890    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp" event={"ID":"08246df6-a688-48cf-8ff7-2fba5e44bc34","Type":"ContainerStarted","Data":"b5143f608519022da39e38fbc6267565d98a683395abb6fffc678239aacb8feb"}
Sep 10 15:41:02.300110 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:02.299987    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp" event={"ID":"08246df6-a688-48cf-8ff7-2fba5e44bc34","Type":"ContainerStarted","Data":"f899bad45b576e696921b2a0da3e7168611c6c9e81a9af4c475e57bce708ffa5"}
Sep 10 15:41:02.320786 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:02.320736    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp" podStartSLOduration=1.320719574 podStartE2EDuration="1.320719574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:41:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:41:02.318921865 +0000 UTC m=+1515.368720373" watchObservedRunningTime="2026-09-10 15:41:02.320719574 +0000 UTC m=+1515.370518082"
Sep 10 15:41:02.744279 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:02.744187    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:03.749375 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:03.749344    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:04.312446 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:04.312412    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:04.313864 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:04.313844    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:05.419410 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:05.419376    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"]
Sep 10 15:41:05.420011 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:05.419991    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" containerName="istio-proxy"
Sep 10 15:41:05.420083 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:05.420013    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bfef2a1-12a1-4072-9a63-6b08b5bf7d0a" containerName="istio-proxy"
Sep 10 15:41:05.423941 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:05.423905    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"
Sep 10 15:41:05.426519 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:05.426499    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-ba5c7e-serving-cert\""
Sep 10 15:41:05.428538 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:05.428506    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 15:41:05.429000 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:05.428526    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 15:41:05.429000 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:05.428526    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 15:41:05.429000 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:05.428551    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gljcp\""
Sep 10 15:41:05.433713 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:05.433669    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"]
Sep 10 15:41:05.511997 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:05.511960    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ce97193-c7fe-4a32-8774-69cea736fbb4-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s\" (UID: \"8ce97193-c7fe-4a32-8774-69cea736fbb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"
Sep 10 15:41:05.512186 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:05.512048    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce97193-c7fe-4a32-8774-69cea736fbb4-metrics-certs\") pod \"maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s\" (UID: \"8ce97193-c7fe-4a32-8774-69cea736fbb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"
Sep 10 15:41:05.512186 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:05.512148    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ce97193-c7fe-4a32-8774-69cea736fbb4-maas-api-tls\") pod \"maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s\" (UID: \"8ce97193-c7fe-4a32-8774-69cea736fbb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"
Sep 10 15:41:05.512263 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:05.512203    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s98dv\" (UniqueName: \"kubernetes.io/projected/8ce97193-c7fe-4a32-8774-69cea736fbb4-kube-api-access-s98dv\") pod \"maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s\" (UID: \"8ce97193-c7fe-4a32-8774-69cea736fbb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"
Sep 10 15:41:05.612879 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:05.612842    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s98dv\" (UniqueName: \"kubernetes.io/projected/8ce97193-c7fe-4a32-8774-69cea736fbb4-kube-api-access-s98dv\") pod \"maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s\" (UID: \"8ce97193-c7fe-4a32-8774-69cea736fbb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"
Sep 10 15:41:05.612879 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:05.612884    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ce97193-c7fe-4a32-8774-69cea736fbb4-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s\" (UID: \"8ce97193-c7fe-4a32-8774-69cea736fbb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"
Sep 10 15:41:05.613198 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:05.613007    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce97193-c7fe-4a32-8774-69cea736fbb4-metrics-certs\") pod \"maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s\" (UID: \"8ce97193-c7fe-4a32-8774-69cea736fbb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"
Sep 10 15:41:05.613198 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:05.613141    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ce97193-c7fe-4a32-8774-69cea736fbb4-maas-api-tls\") pod \"maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s\" (UID: \"8ce97193-c7fe-4a32-8774-69cea736fbb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"
Sep 10 15:41:05.613287 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:41:05.613264    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-serving-cert: secret "maas-api-e2e-ipp-a-ba5c7e-serving-cert" not found
Sep 10 15:41:05.613345 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:41:05.613334    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ce97193-c7fe-4a32-8774-69cea736fbb4-maas-api-tls podName:8ce97193-c7fe-4a32-8774-69cea736fbb4 nodeName:}" failed. No retries permitted until 2026-09-10 15:41:06.113315817 +0000 UTC m=+1519.163114303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8ce97193-c7fe-4a32-8774-69cea736fbb4-maas-api-tls") pod "maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s" (UID: "8ce97193-c7fe-4a32-8774-69cea736fbb4") : secret "maas-api-e2e-ipp-a-ba5c7e-serving-cert" not found
Sep 10 15:41:05.613651 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:05.613631    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ce97193-c7fe-4a32-8774-69cea736fbb4-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s\" (UID: \"8ce97193-c7fe-4a32-8774-69cea736fbb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"
Sep 10 15:41:05.615534 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:05.615513    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce97193-c7fe-4a32-8774-69cea736fbb4-metrics-certs\") pod \"maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s\" (UID: \"8ce97193-c7fe-4a32-8774-69cea736fbb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"
Sep 10 15:41:05.622077 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:05.622048    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s98dv\" (UniqueName: \"kubernetes.io/projected/8ce97193-c7fe-4a32-8774-69cea736fbb4-kube-api-access-s98dv\") pod \"maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s\" (UID: \"8ce97193-c7fe-4a32-8774-69cea736fbb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"
Sep 10 15:41:06.118532 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:06.118493    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ce97193-c7fe-4a32-8774-69cea736fbb4-maas-api-tls\") pod \"maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s\" (UID: \"8ce97193-c7fe-4a32-8774-69cea736fbb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"
Sep 10 15:41:06.120887 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:06.120862    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ce97193-c7fe-4a32-8774-69cea736fbb4-maas-api-tls\") pod \"maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s\" (UID: \"8ce97193-c7fe-4a32-8774-69cea736fbb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"
Sep 10 15:41:06.338392 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:06.338360    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"
Sep 10 15:41:06.616714 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:06.615362    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"]
Sep 10 15:41:06.618741 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:06.618713    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 15:41:07.333216 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:07.333182    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s" event={"ID":"8ce97193-c7fe-4a32-8774-69cea736fbb4","Type":"ContainerStarted","Data":"2a2fc9ffda5d873e0fa41a81a3be7305cad70bd93848b4cc8075722dd6e8ce8c"}
Sep 10 15:41:07.333387 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:07.333243    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s" event={"ID":"8ce97193-c7fe-4a32-8774-69cea736fbb4","Type":"ContainerStarted","Data":"5e75a7a42a9d82bbd79b8f7ff4275316dfb3b3b85bd08344dbf721c7736023b8"}
Sep 10 15:41:07.333387 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:07.333268    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"
Sep 10 15:41:07.353321 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:07.353267    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s" podStartSLOduration=1.862377318 podStartE2EDuration="2.353252286s" totalImagesPullingTime="490.874968ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:41:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:41:07.350736021 +0000 UTC m=+1520.400534530" watchObservedRunningTime="2026-09-10 15:41:07.353252286 +0000 UTC m=+1520.403050838"
Sep 10 15:41:13.353305 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:13.353202    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"
Sep 10 15:41:19.314360 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:19.314321    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 10 15:41:19.314769 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:19.314379    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp" podUID="08246df6-a688-48cf-8ff7-2fba5e44bc34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 10 15:41:19.412972 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:19.412866    2574 generic.go:356] "Generic (PLEG): container finished" podID="08246df6-a688-48cf-8ff7-2fba5e44bc34" containerID="b5143f608519022da39e38fbc6267565d98a683395abb6fffc678239aacb8feb" exitCode=0
Sep 10 15:41:19.412972 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:19.412946    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp" event={"ID":"08246df6-a688-48cf-8ff7-2fba5e44bc34","Type":"ContainerDied","Data":"b5143f608519022da39e38fbc6267565d98a683395abb6fffc678239aacb8feb"}
Sep 10 15:41:19.413420 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:19.413390    2574 scope.go:117] "RemoveContainer" containerID="b5143f608519022da39e38fbc6267565d98a683395abb6fffc678239aacb8feb"
Sep 10 15:41:19.414488 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:19.414459    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:41:19.414569 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:19.414527    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:41:19.414569 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:19.414560    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:41:20.420713 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:20.420680    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp" event={"ID":"08246df6-a688-48cf-8ff7-2fba5e44bc34","Type":"ContainerStarted","Data":"480041201ed7a3022db2ad062ad02320695f1e81370c4353998e097d4d85a794"}
Sep 10 15:41:20.743907 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:20.743797    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:20.744669 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:20.744637    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 10 15:41:20.744874 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:20.744848    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp" podUID="08246df6-a688-48cf-8ff7-2fba5e44bc34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 10 15:41:21.743519 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:21.743472    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 10 15:41:21.744053 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:21.743546    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp" podUID="08246df6-a688-48cf-8ff7-2fba5e44bc34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 10 15:41:22.744334 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:22.744293    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 10 15:41:22.744967 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:22.744909    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp" podUID="08246df6-a688-48cf-8ff7-2fba5e44bc34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 10 15:41:23.744383 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:23.743824    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 10 15:41:23.744383 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:23.743891    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp" podUID="08246df6-a688-48cf-8ff7-2fba5e44bc34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 10 15:41:24.743883 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:24.743838    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 10 15:41:24.744222 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:24.744191    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp" podUID="08246df6-a688-48cf-8ff7-2fba5e44bc34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 10 15:41:25.743541 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:25.743503    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 10 15:41:25.744036 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:25.743578    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp" podUID="08246df6-a688-48cf-8ff7-2fba5e44bc34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 10 15:41:26.778457 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:26.778426    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:26.778967 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:26.778827    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:26.779695 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:26.779676    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:41:30.099682 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.099641    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"]
Sep 10 15:41:30.109462 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.109431    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.112590 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.112556    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-09b833-openshift-default-dockercfg-gflr8\""
Sep 10 15:41:30.115788 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.115761    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"]
Sep 10 15:41:30.157161 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.157122    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-workload-certs\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.157345 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.157180    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-workload-socket\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.157345 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.157218    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istiod-ca-cert\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.157345 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.157243    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5djm\" (UniqueName: \"kubernetes.io/projected/3bc600ed-89fd-4866-8a9c-e864b01c43d7-kube-api-access-x5djm\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.157345 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.157264    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-envoy\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.157502 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.157343    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-data\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.157502 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.157384    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-token\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.157502 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.157403    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-credential-socket\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.157502 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.157462    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-podinfo\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.258837 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.258796    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-envoy\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.259072 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.258850    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-data\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.259072 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.258878    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-token\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.259072 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.258896    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-credential-socket\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.259072 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.258925    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-podinfo\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.259072 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.259004    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-workload-certs\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.259072 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.259040    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-workload-socket\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.259072 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.259057    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istiod-ca-cert\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.259072 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.259073    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5djm\" (UniqueName: \"kubernetes.io/projected/3bc600ed-89fd-4866-8a9c-e864b01c43d7-kube-api-access-x5djm\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.259496 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.259397    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-credential-socket\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.259496 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.259475    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-data\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.259571 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.259555    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-workload-certs\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.259678 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.259647    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-workload-socket\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.259811 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.259795    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istiod-ca-cert\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.261280 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.261258    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-envoy\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.261409 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.261389    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-podinfo\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.268004 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.267984    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5djm\" (UniqueName: \"kubernetes.io/projected/3bc600ed-89fd-4866-8a9c-e864b01c43d7-kube-api-access-x5djm\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.268086 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.268037    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-token\") pod \"e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") " pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.422370 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.422284    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:30.701095 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.701069    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"]
Sep 10 15:41:30.702354 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:41:30.702326    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc600ed_89fd_4866_8a9c_e864b01c43d7.slice/crio-e18d5ffe5e5e7cf52d49d1fb9156ce0a2e41acdf7062dca778fac104de404aab WatchSource:0}: Error finding container e18d5ffe5e5e7cf52d49d1fb9156ce0a2e41acdf7062dca778fac104de404aab: Status 404 returned error can't find the container with id e18d5ffe5e5e7cf52d49d1fb9156ce0a2e41acdf7062dca778fac104de404aab
Sep 10 15:41:30.704681 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.704648    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:41:30.704788 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.704730    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:41:30.704788 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:30.704773    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:41:31.499024 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:31.498990    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn" event={"ID":"3bc600ed-89fd-4866-8a9c-e864b01c43d7","Type":"ContainerStarted","Data":"3b6a5eca5017688ce6b4eda540575b3e4275dd450039c2cfa231ebfdad5ccc34"}
Sep 10 15:41:31.499580 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:31.499046    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn" event={"ID":"3bc600ed-89fd-4866-8a9c-e864b01c43d7","Type":"ContainerStarted","Data":"e18d5ffe5e5e7cf52d49d1fb9156ce0a2e41acdf7062dca778fac104de404aab"}
Sep 10 15:41:31.525204 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:31.525149    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn" podStartSLOduration=1.5251313579999999 podStartE2EDuration="1.525131358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:41:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:41:31.521483794 +0000 UTC m=+1544.571282305" watchObservedRunningTime="2026-09-10 15:41:31.525131358 +0000 UTC m=+1544.574929866"
Sep 10 15:41:32.422840 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:32.422803    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:32.428092 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:32.428068    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:32.505010 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:32.504977    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:32.505908 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:32.505885    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:34.524886 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:34.524856    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"]
Sep 10 15:41:34.527780 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:34.527761    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"
Sep 10 15:41:34.530284 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:34.530261    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-09b833-serving-cert\""
Sep 10 15:41:34.541292 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:34.541270    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"]
Sep 10 15:41:34.606025 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:34.605990    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57mkt\" (UniqueName: \"kubernetes.io/projected/8343eb81-28e0-4d76-8453-57b9ea929f14-kube-api-access-57mkt\") pod \"maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42\" (UID: \"8343eb81-28e0-4d76-8453-57b9ea929f14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"
Sep 10 15:41:34.606198 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:34.606062    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8343eb81-28e0-4d76-8453-57b9ea929f14-metrics-certs\") pod \"maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42\" (UID: \"8343eb81-28e0-4d76-8453-57b9ea929f14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"
Sep 10 15:41:34.606242 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:34.606201    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8343eb81-28e0-4d76-8453-57b9ea929f14-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42\" (UID: \"8343eb81-28e0-4d76-8453-57b9ea929f14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"
Sep 10 15:41:34.606291 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:34.606271    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8343eb81-28e0-4d76-8453-57b9ea929f14-maas-api-tls\") pod \"maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42\" (UID: \"8343eb81-28e0-4d76-8453-57b9ea929f14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"
Sep 10 15:41:34.706891 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:34.706848    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8343eb81-28e0-4d76-8453-57b9ea929f14-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42\" (UID: \"8343eb81-28e0-4d76-8453-57b9ea929f14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"
Sep 10 15:41:34.706891 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:34.706898    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8343eb81-28e0-4d76-8453-57b9ea929f14-maas-api-tls\") pod \"maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42\" (UID: \"8343eb81-28e0-4d76-8453-57b9ea929f14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"
Sep 10 15:41:34.707149 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:34.706989    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57mkt\" (UniqueName: \"kubernetes.io/projected/8343eb81-28e0-4d76-8453-57b9ea929f14-kube-api-access-57mkt\") pod \"maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42\" (UID: \"8343eb81-28e0-4d76-8453-57b9ea929f14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"
Sep 10 15:41:34.707149 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:34.707045    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8343eb81-28e0-4d76-8453-57b9ea929f14-metrics-certs\") pod \"maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42\" (UID: \"8343eb81-28e0-4d76-8453-57b9ea929f14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"
Sep 10 15:41:34.707149 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:41:34.707088    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-serving-cert: secret "maas-api-e2e-ipp-b-09b833-serving-cert" not found
Sep 10 15:41:34.707321 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:41:34.707190    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8343eb81-28e0-4d76-8453-57b9ea929f14-maas-api-tls podName:8343eb81-28e0-4d76-8453-57b9ea929f14 nodeName:}" failed. No retries permitted until 2026-09-10 15:41:35.20716791 +0000 UTC m=+1548.256966398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8343eb81-28e0-4d76-8453-57b9ea929f14-maas-api-tls") pod "maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42" (UID: "8343eb81-28e0-4d76-8453-57b9ea929f14") : secret "maas-api-e2e-ipp-b-09b833-serving-cert" not found
Sep 10 15:41:34.707635 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:34.707614    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8343eb81-28e0-4d76-8453-57b9ea929f14-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42\" (UID: \"8343eb81-28e0-4d76-8453-57b9ea929f14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"
Sep 10 15:41:34.709665 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:34.709638    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8343eb81-28e0-4d76-8453-57b9ea929f14-metrics-certs\") pod \"maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42\" (UID: \"8343eb81-28e0-4d76-8453-57b9ea929f14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"
Sep 10 15:41:34.716332 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:34.716312    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57mkt\" (UniqueName: \"kubernetes.io/projected/8343eb81-28e0-4d76-8453-57b9ea929f14-kube-api-access-57mkt\") pod \"maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42\" (UID: \"8343eb81-28e0-4d76-8453-57b9ea929f14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"
Sep 10 15:41:35.213652 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:35.213614    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8343eb81-28e0-4d76-8453-57b9ea929f14-maas-api-tls\") pod \"maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42\" (UID: \"8343eb81-28e0-4d76-8453-57b9ea929f14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"
Sep 10 15:41:35.216136 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:35.216110    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8343eb81-28e0-4d76-8453-57b9ea929f14-maas-api-tls\") pod \"maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42\" (UID: \"8343eb81-28e0-4d76-8453-57b9ea929f14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"
Sep 10 15:41:35.439925 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:35.439892    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"
Sep 10 15:41:35.712734 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:35.712702    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"]
Sep 10 15:41:35.713954 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:41:35.713900    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8343eb81_28e0_4d76_8453_57b9ea929f14.slice/crio-0d2c47f4282394c8dea64c1228b26e93961dafb3dbf3e20ff8a02220fef38b46 WatchSource:0}: Error finding container 0d2c47f4282394c8dea64c1228b26e93961dafb3dbf3e20ff8a02220fef38b46: Status 404 returned error can't find the container with id 0d2c47f4282394c8dea64c1228b26e93961dafb3dbf3e20ff8a02220fef38b46
Sep 10 15:41:36.531346 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:36.531243    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42" event={"ID":"8343eb81-28e0-4d76-8453-57b9ea929f14","Type":"ContainerStarted","Data":"bc33151d24459bea36c9c28396b23d49d3f3edc1e225776924132364d1830dae"}
Sep 10 15:41:36.531346 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:36.531302    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42" event={"ID":"8343eb81-28e0-4d76-8453-57b9ea929f14","Type":"ContainerStarted","Data":"0d2c47f4282394c8dea64c1228b26e93961dafb3dbf3e20ff8a02220fef38b46"}
Sep 10 15:41:36.531346 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:36.531334    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"
Sep 10 15:41:36.553221 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:36.553162    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42" podStartSLOduration=2.198330304 podStartE2EDuration="2.553145297s" totalImagesPullingTime="354.814993ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:41:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:41:36.550139832 +0000 UTC m=+1549.599938344" watchObservedRunningTime="2026-09-10 15:41:36.553145297 +0000 UTC m=+1549.602943838"
Sep 10 15:41:42.552440 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:42.552399    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"
Sep 10 15:41:48.547126 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:48.547088    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 15:41:48.547522 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:48.547146    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn" podUID="3bc600ed-89fd-4866-8a9c-e864b01c43d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 15:41:49.614083 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:49.614045    2574 generic.go:356] "Generic (PLEG): container finished" podID="3bc600ed-89fd-4866-8a9c-e864b01c43d7" containerID="3b6a5eca5017688ce6b4eda540575b3e4275dd450039c2cfa231ebfdad5ccc34" exitCode=0
Sep 10 15:41:49.614516 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:49.614122    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn" event={"ID":"3bc600ed-89fd-4866-8a9c-e864b01c43d7","Type":"ContainerDied","Data":"3b6a5eca5017688ce6b4eda540575b3e4275dd450039c2cfa231ebfdad5ccc34"}
Sep 10 15:41:49.614629 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:49.614610    2574 scope.go:117] "RemoveContainer" containerID="3b6a5eca5017688ce6b4eda540575b3e4275dd450039c2cfa231ebfdad5ccc34"
Sep 10 15:41:49.615698 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:49.615669    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:41:49.615750 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:49.615737    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:41:49.615788 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:49.615769    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:41:50.623501 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:50.623463    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn" event={"ID":"3bc600ed-89fd-4866-8a9c-e864b01c43d7","Type":"ContainerStarted","Data":"416efb0ae87b38eb0cd5368f522744c9ec65cf5657298c692c10866063cc0bc5"}
Sep 10 15:41:51.422603 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:51.422566    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:51.422857 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:51.422834    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 10 15:41:51.422968 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:51.422890    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn" podUID="3bc600ed-89fd-4866-8a9c-e864b01c43d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 10 15:41:52.423102 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:52.423068    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 10 15:41:52.423478 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:52.423119    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn" podUID="3bc600ed-89fd-4866-8a9c-e864b01c43d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 10 15:41:53.423611 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:53.423579    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 10 15:41:53.424036 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:53.423635    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn" podUID="3bc600ed-89fd-4866-8a9c-e864b01c43d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 10 15:41:54.423364 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:54.423329    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 10 15:41:54.423554 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:54.423384    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn" podUID="3bc600ed-89fd-4866-8a9c-e864b01c43d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 10 15:41:55.423571 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:55.423536    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 10 15:41:55.424011 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:55.423586    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn" podUID="3bc600ed-89fd-4866-8a9c-e864b01c43d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 10 15:41:56.422644 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:56.422608    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 10 15:41:56.422824 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:56.422669    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn" podUID="3bc600ed-89fd-4866-8a9c-e864b01c43d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 10 15:41:57.426524 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:57.426494    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:57.426914 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:57.426851    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:41:57.427531 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:41:57.427515    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:42:48.963219 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:48.963139    2574 scope.go:117] "RemoveContainer" containerID="a53732f4067db6be35d264caae6f950e640d0f0321691c4bed7d7c3919eb412d"
Sep 10 15:42:50.123976 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.123917    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"]
Sep 10 15:42:50.127755 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.127729    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.130324 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.130301    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-810029-openshift-default-dockercfg-29g52\""
Sep 10 15:42:50.136978 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.136954    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"]
Sep 10 15:42:50.250718 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.250681    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-data\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.250909 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.250747    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b55nj\" (UniqueName: \"kubernetes.io/projected/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-kube-api-access-b55nj\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.250909 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.250790    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-envoy\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.250909 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.250855    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-credential-socket\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.250909 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.250875    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.250909 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.250902    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-workload-socket\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.251146 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.251014    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-workload-certs\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.251146 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.251063    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-token\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.251146 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.251133    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-podinfo\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.352408 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.352363    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-credential-socket\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.352408 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.352408    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.352676 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.352427    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-workload-socket\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.352676 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.352453    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-workload-certs\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.352676 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.352487    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-token\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.352676 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.352542    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-podinfo\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.352676 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.352597    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-data\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.352676 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.352648    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b55nj\" (UniqueName: \"kubernetes.io/projected/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-kube-api-access-b55nj\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.353059 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.352682    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-envoy\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.353059 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.352828    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-credential-socket\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.353059 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.352848    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-workload-certs\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.353059 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.353006    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-data\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.353271 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.353207    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-workload-socket\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.353271 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.353254    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.354966 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.354917    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-envoy\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.355180 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.355161    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-podinfo\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.360449 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.360424    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-token\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.360616 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.360599    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b55nj\" (UniqueName: \"kubernetes.io/projected/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-kube-api-access-b55nj\") pod \"e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") " pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.439250 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.439169    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:50.717699 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.717670    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"]
Sep 10 15:42:50.719552 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:42:50.719524    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode50c6e34_d5b6_44a3_9d28_5ea4f9978e5b.slice/crio-d41ec35cb5335bdf834f1d6b5a5743893465010ff20ab95912f36b96d91f4677 WatchSource:0}: Error finding container d41ec35cb5335bdf834f1d6b5a5743893465010ff20ab95912f36b96d91f4677: Status 404 returned error can't find the container with id d41ec35cb5335bdf834f1d6b5a5743893465010ff20ab95912f36b96d91f4677
Sep 10 15:42:50.722349 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.722313    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:42:50.722457 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.722388    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:42:50.722457 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.722434    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:42:50.999846 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.999750    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt" event={"ID":"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b","Type":"ContainerStarted","Data":"4bbaacb640834edda68f406f9e483f0b0395dbcdfa2333bc12a4b01e0122efcb"}
Sep 10 15:42:50.999846 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:50.999812    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt" event={"ID":"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b","Type":"ContainerStarted","Data":"d41ec35cb5335bdf834f1d6b5a5743893465010ff20ab95912f36b96d91f4677"}
Sep 10 15:42:51.023218 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:51.023159    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt" podStartSLOduration=1.023140876 podStartE2EDuration="1.023140876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:42:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:42:51.020611731 +0000 UTC m=+1624.070410240" watchObservedRunningTime="2026-09-10 15:42:51.023140876 +0000 UTC m=+1624.072939383"
Sep 10 15:42:51.440215 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:51.440180    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:51.445813 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:51.445786    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:52.005505 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:52.005473    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:42:52.006408 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:42:52.006389    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:43:14.132639 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:14.132601    2574 generic.go:356] "Generic (PLEG): container finished" podID="e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" containerID="4bbaacb640834edda68f406f9e483f0b0395dbcdfa2333bc12a4b01e0122efcb" exitCode=0
Sep 10 15:43:14.133177 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:14.132676    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt" event={"ID":"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b","Type":"ContainerDied","Data":"4bbaacb640834edda68f406f9e483f0b0395dbcdfa2333bc12a4b01e0122efcb"}
Sep 10 15:43:14.133268 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:14.133251    2574 scope.go:117] "RemoveContainer" containerID="4bbaacb640834edda68f406f9e483f0b0395dbcdfa2333bc12a4b01e0122efcb"
Sep 10 15:43:14.134418 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:14.134386    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:43:14.134512 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:14.134455    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:43:14.134512 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:14.134486    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 15:43:15.145782 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:15.145740    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt" event={"ID":"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b","Type":"ContainerStarted","Data":"8bb4f8f62e9c25a6b0a5f68f1477a71b19ebcf54e27e032bd1e990f280311d0c"}
Sep 10 15:43:15.439690 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:15.439588    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:43:15.439990 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:15.439960    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Sep 10 15:43:15.440118 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:15.440027    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt" podUID="e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Sep 10 15:43:16.440238 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:16.440189    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Sep 10 15:43:16.440743 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:16.440262    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt" podUID="e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Sep 10 15:43:17.440469 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:17.440433    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Sep 10 15:43:17.441065 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:17.441032    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt" podUID="e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Sep 10 15:43:18.439895 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:18.439844    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Sep 10 15:43:18.440126 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:18.439945    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt" podUID="e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Sep 10 15:43:19.440097 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:19.440057    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Sep 10 15:43:19.440680 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:19.440648    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt" podUID="e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Sep 10 15:43:20.444196 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:20.444162    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:43:20.444583 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:20.444516    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:43:20.445093 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:20.445077    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:43:32.120418 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:32.120378    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"]
Sep 10 15:43:32.120896 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:32.120680    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt" podUID="e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" containerName="istio-proxy" containerID="cri-o://8bb4f8f62e9c25a6b0a5f68f1477a71b19ebcf54e27e032bd1e990f280311d0c" gracePeriod=30
Sep 10 15:43:35.447007 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:35.446969    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 10 15:43:35.447396 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:35.447038    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt" podUID="e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 15:43:37.285097 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.285034    2574 generic.go:356] "Generic (PLEG): container finished" podID="e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" containerID="8bb4f8f62e9c25a6b0a5f68f1477a71b19ebcf54e27e032bd1e990f280311d0c" exitCode=0
Sep 10 15:43:37.285457 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.285123    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt" event={"ID":"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b","Type":"ContainerDied","Data":"8bb4f8f62e9c25a6b0a5f68f1477a71b19ebcf54e27e032bd1e990f280311d0c"}
Sep 10 15:43:37.285457 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.285205    2574 scope.go:117] "RemoveContainer" containerID="4bbaacb640834edda68f406f9e483f0b0395dbcdfa2333bc12a4b01e0122efcb"
Sep 10 15:43:37.373269 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.373237    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:43:37.554783 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.554755    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-workload-certs\") pod \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") "
Sep 10 15:43:37.555011 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.554796    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-token\") pod \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") "
Sep 10 15:43:37.555011 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.554822    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-workload-socket\") pod \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") "
Sep 10 15:43:37.555011 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.554840    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istiod-ca-cert\") pod \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") "
Sep 10 15:43:37.555011 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.554879    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-data\") pod \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") "
Sep 10 15:43:37.555011 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.554900    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-envoy\") pod \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") "
Sep 10 15:43:37.555011 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.554965    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b55nj\" (UniqueName: \"kubernetes.io/projected/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-kube-api-access-b55nj\") pod \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") "
Sep 10 15:43:37.555011 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.554989    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-credential-socket\") pod \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") "
Sep 10 15:43:37.555011 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.555010    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-podinfo\") pod \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\" (UID: \"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b\") "
Sep 10 15:43:37.555520 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.555099    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" (UID: "e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:43:37.555520 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.555290    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-data" (OuterVolumeSpecName: "istio-data") pod "e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" (UID: "e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:43:37.555520 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.555341    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" (UID: "e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:43:37.555520 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.555394    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" (UID: "e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:43:37.555520 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.555482    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-workload-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:43:37.555520 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.555490    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" (UID: "e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:43:37.555520 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.555501    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-data\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:43:37.555854 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.555535    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-credential-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:43:37.557121 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.557093    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-token" (OuterVolumeSpecName: "istio-token") pod "e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" (UID: "e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:43:37.557465 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.557437    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" (UID: "e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:43:37.557557 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.557492    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-kube-api-access-b55nj" (OuterVolumeSpecName: "kube-api-access-b55nj") pod "e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" (UID: "e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b"). InnerVolumeSpecName "kube-api-access-b55nj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:43:37.557605 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.557573    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" (UID: "e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:43:37.656212 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.656173    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-workload-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:43:37.656212 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.656205    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-token\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:43:37.656212 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.656213    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istiod-ca-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:43:37.656212 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.656221    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-envoy\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:43:37.656491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.656231    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b55nj\" (UniqueName: \"kubernetes.io/projected/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-kube-api-access-b55nj\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:43:37.656491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:37.656240    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b-istio-podinfo\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:43:38.291998 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:38.291965    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"
Sep 10 15:43:38.292425 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:38.291967    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt" event={"ID":"e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b","Type":"ContainerDied","Data":"d41ec35cb5335bdf834f1d6b5a5743893465010ff20ab95912f36b96d91f4677"}
Sep 10 15:43:38.292425 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:38.292125    2574 scope.go:117] "RemoveContainer" containerID="8bb4f8f62e9c25a6b0a5f68f1477a71b19ebcf54e27e032bd1e990f280311d0c"
Sep 10 15:43:38.318563 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:38.318534    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"]
Sep 10 15:43:38.322727 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:38.322704    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-810029-openshift-default-dbc677f96-jhwjt"]
Sep 10 15:43:39.409819 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:39.409787    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" path="/var/lib/kubelet/pods/e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b/volumes"
Sep 10 15:43:51.044347 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.044303    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"]
Sep 10 15:43:51.044797 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.044561    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s" podUID="8ce97193-c7fe-4a32-8774-69cea736fbb4" containerName="maas-api" containerID="cri-o://2a2fc9ffda5d873e0fa41a81a3be7305cad70bd93848b4cc8075722dd6e8ce8c" gracePeriod=30
Sep 10 15:43:51.288666 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.288640    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"
Sep 10 15:43:51.368329 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.368233    2574 generic.go:356] "Generic (PLEG): container finished" podID="8ce97193-c7fe-4a32-8774-69cea736fbb4" containerID="2a2fc9ffda5d873e0fa41a81a3be7305cad70bd93848b4cc8075722dd6e8ce8c" exitCode=0
Sep 10 15:43:51.368329 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.368288    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"
Sep 10 15:43:51.368329 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.368314    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s" event={"ID":"8ce97193-c7fe-4a32-8774-69cea736fbb4","Type":"ContainerDied","Data":"2a2fc9ffda5d873e0fa41a81a3be7305cad70bd93848b4cc8075722dd6e8ce8c"}
Sep 10 15:43:51.368632 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.368382    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s" event={"ID":"8ce97193-c7fe-4a32-8774-69cea736fbb4","Type":"ContainerDied","Data":"5e75a7a42a9d82bbd79b8f7ff4275316dfb3b3b85bd08344dbf721c7736023b8"}
Sep 10 15:43:51.368632 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.368410    2574 scope.go:117] "RemoveContainer" containerID="2a2fc9ffda5d873e0fa41a81a3be7305cad70bd93848b4cc8075722dd6e8ce8c"
Sep 10 15:43:51.378961 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.378905    2574 scope.go:117] "RemoveContainer" containerID="2a2fc9ffda5d873e0fa41a81a3be7305cad70bd93848b4cc8075722dd6e8ce8c"
Sep 10 15:43:51.379267 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:43:51.379250    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a2fc9ffda5d873e0fa41a81a3be7305cad70bd93848b4cc8075722dd6e8ce8c\": container with ID starting with 2a2fc9ffda5d873e0fa41a81a3be7305cad70bd93848b4cc8075722dd6e8ce8c not found: ID does not exist" containerID="2a2fc9ffda5d873e0fa41a81a3be7305cad70bd93848b4cc8075722dd6e8ce8c"
Sep 10 15:43:51.379331 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.379278    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2fc9ffda5d873e0fa41a81a3be7305cad70bd93848b4cc8075722dd6e8ce8c"} err="failed to get container status \"2a2fc9ffda5d873e0fa41a81a3be7305cad70bd93848b4cc8075722dd6e8ce8c\": rpc error: code = NotFound desc = could not find container \"2a2fc9ffda5d873e0fa41a81a3be7305cad70bd93848b4cc8075722dd6e8ce8c\": container with ID starting with 2a2fc9ffda5d873e0fa41a81a3be7305cad70bd93848b4cc8075722dd6e8ce8c not found: ID does not exist"
Sep 10 15:43:51.396614 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.396589    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s98dv\" (UniqueName: \"kubernetes.io/projected/8ce97193-c7fe-4a32-8774-69cea736fbb4-kube-api-access-s98dv\") pod \"8ce97193-c7fe-4a32-8774-69cea736fbb4\" (UID: \"8ce97193-c7fe-4a32-8774-69cea736fbb4\") "
Sep 10 15:43:51.396717 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.396652    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ce97193-c7fe-4a32-8774-69cea736fbb4-openshift-service-ca\") pod \"8ce97193-c7fe-4a32-8774-69cea736fbb4\" (UID: \"8ce97193-c7fe-4a32-8774-69cea736fbb4\") "
Sep 10 15:43:51.396717 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.396703    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ce97193-c7fe-4a32-8774-69cea736fbb4-maas-api-tls\") pod \"8ce97193-c7fe-4a32-8774-69cea736fbb4\" (UID: \"8ce97193-c7fe-4a32-8774-69cea736fbb4\") "
Sep 10 15:43:51.396802 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.396788    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce97193-c7fe-4a32-8774-69cea736fbb4-metrics-certs\") pod \"8ce97193-c7fe-4a32-8774-69cea736fbb4\" (UID: \"8ce97193-c7fe-4a32-8774-69cea736fbb4\") "
Sep 10 15:43:51.397086 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.397054    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ce97193-c7fe-4a32-8774-69cea736fbb4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8ce97193-c7fe-4a32-8774-69cea736fbb4" (UID: "8ce97193-c7fe-4a32-8774-69cea736fbb4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:43:51.397208 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.397177    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ce97193-c7fe-4a32-8774-69cea736fbb4-openshift-service-ca\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:43:51.398740 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.398711    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ce97193-c7fe-4a32-8774-69cea736fbb4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8ce97193-c7fe-4a32-8774-69cea736fbb4" (UID: "8ce97193-c7fe-4a32-8774-69cea736fbb4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:43:51.398843 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.398801    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ce97193-c7fe-4a32-8774-69cea736fbb4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8ce97193-c7fe-4a32-8774-69cea736fbb4" (UID: "8ce97193-c7fe-4a32-8774-69cea736fbb4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:43:51.398843 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.398807    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ce97193-c7fe-4a32-8774-69cea736fbb4-kube-api-access-s98dv" (OuterVolumeSpecName: "kube-api-access-s98dv") pod "8ce97193-c7fe-4a32-8774-69cea736fbb4" (UID: "8ce97193-c7fe-4a32-8774-69cea736fbb4"). InnerVolumeSpecName "kube-api-access-s98dv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:43:51.498535 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.498505    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ce97193-c7fe-4a32-8774-69cea736fbb4-maas-api-tls\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:43:51.498535 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.498534    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce97193-c7fe-4a32-8774-69cea736fbb4-metrics-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:43:51.498739 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.498546    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s98dv\" (UniqueName: \"kubernetes.io/projected/8ce97193-c7fe-4a32-8774-69cea736fbb4-kube-api-access-s98dv\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:43:51.685716 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.685601    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"]
Sep 10 15:43:51.688504 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:51.688477    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba5c7e-7764694556-7l45s"]
Sep 10 15:43:53.409039 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:43:53.409006    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ce97193-c7fe-4a32-8774-69cea736fbb4" path="/var/lib/kubelet/pods/8ce97193-c7fe-4a32-8774-69cea736fbb4/volumes"
Sep 10 15:44:40.118171 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:40.118134    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"]
Sep 10 15:44:40.118721 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:40.118400    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp" podUID="08246df6-a688-48cf-8ff7-2fba5e44bc34" containerName="istio-proxy" containerID="cri-o://480041201ed7a3022db2ad062ad02320695f1e81370c4353998e097d4d85a794" gracePeriod=30
Sep 10 15:44:41.781780 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:41.781741    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 15:44:41.782168 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:41.781807    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp" podUID="08246df6-a688-48cf-8ff7-2fba5e44bc34" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 15:44:45.373772 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.373742    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:44:45.530337 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.530236    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-credential-socket\") pod \"08246df6-a688-48cf-8ff7-2fba5e44bc34\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") "
Sep 10 15:44:45.530337 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.530325    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-token\") pod \"08246df6-a688-48cf-8ff7-2fba5e44bc34\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") "
Sep 10 15:44:45.530573 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.530374    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-workload-certs\") pod \"08246df6-a688-48cf-8ff7-2fba5e44bc34\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") "
Sep 10 15:44:45.530573 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.530431    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-podinfo\") pod \"08246df6-a688-48cf-8ff7-2fba5e44bc34\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") "
Sep 10 15:44:45.530573 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.530450    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-workload-socket\") pod \"08246df6-a688-48cf-8ff7-2fba5e44bc34\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") "
Sep 10 15:44:45.530573 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.530479    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-envoy\") pod \"08246df6-a688-48cf-8ff7-2fba5e44bc34\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") "
Sep 10 15:44:45.530573 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.530501    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-data\") pod \"08246df6-a688-48cf-8ff7-2fba5e44bc34\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") "
Sep 10 15:44:45.530573 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.530537    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08246df6-a688-48cf-8ff7-2fba5e44bc34-istiod-ca-cert\") pod \"08246df6-a688-48cf-8ff7-2fba5e44bc34\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") "
Sep 10 15:44:45.530573 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.530556    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "08246df6-a688-48cf-8ff7-2fba5e44bc34" (UID: "08246df6-a688-48cf-8ff7-2fba5e44bc34"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:44:45.530961 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.530568    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qd2qf\" (UniqueName: \"kubernetes.io/projected/08246df6-a688-48cf-8ff7-2fba5e44bc34-kube-api-access-qd2qf\") pod \"08246df6-a688-48cf-8ff7-2fba5e44bc34\" (UID: \"08246df6-a688-48cf-8ff7-2fba5e44bc34\") "
Sep 10 15:44:45.530961 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.530796    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "08246df6-a688-48cf-8ff7-2fba5e44bc34" (UID: "08246df6-a688-48cf-8ff7-2fba5e44bc34"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:44:45.530961 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.530816    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "08246df6-a688-48cf-8ff7-2fba5e44bc34" (UID: "08246df6-a688-48cf-8ff7-2fba5e44bc34"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:44:45.531225 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.531133    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08246df6-a688-48cf-8ff7-2fba5e44bc34-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "08246df6-a688-48cf-8ff7-2fba5e44bc34" (UID: "08246df6-a688-48cf-8ff7-2fba5e44bc34"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:44:45.531225 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.531141    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-credential-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:44:45.531225 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.531181    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-workload-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:44:45.531225 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.531198    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-workload-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:44:45.531631 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.531314    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-data" (OuterVolumeSpecName: "istio-data") pod "08246df6-a688-48cf-8ff7-2fba5e44bc34" (UID: "08246df6-a688-48cf-8ff7-2fba5e44bc34"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:44:45.532820 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.532791    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "08246df6-a688-48cf-8ff7-2fba5e44bc34" (UID: "08246df6-a688-48cf-8ff7-2fba5e44bc34"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:44:45.532820 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.532807    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08246df6-a688-48cf-8ff7-2fba5e44bc34-kube-api-access-qd2qf" (OuterVolumeSpecName: "kube-api-access-qd2qf") pod "08246df6-a688-48cf-8ff7-2fba5e44bc34" (UID: "08246df6-a688-48cf-8ff7-2fba5e44bc34"). InnerVolumeSpecName "kube-api-access-qd2qf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:44:45.533048 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.533023    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-token" (OuterVolumeSpecName: "istio-token") pod "08246df6-a688-48cf-8ff7-2fba5e44bc34" (UID: "08246df6-a688-48cf-8ff7-2fba5e44bc34"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:44:45.533048 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.533028    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "08246df6-a688-48cf-8ff7-2fba5e44bc34" (UID: "08246df6-a688-48cf-8ff7-2fba5e44bc34"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:44:45.631714 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.631682    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-envoy\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:44:45.631714 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.631708    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-data\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:44:45.631714 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.631718    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08246df6-a688-48cf-8ff7-2fba5e44bc34-istiod-ca-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:44:45.631976 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.631728    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qd2qf\" (UniqueName: \"kubernetes.io/projected/08246df6-a688-48cf-8ff7-2fba5e44bc34-kube-api-access-qd2qf\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:44:45.631976 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.631736    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-token\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:44:45.631976 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.631745    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08246df6-a688-48cf-8ff7-2fba5e44bc34-istio-podinfo\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:44:45.692955 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.692896    2574 generic.go:356] "Generic (PLEG): container finished" podID="08246df6-a688-48cf-8ff7-2fba5e44bc34" containerID="480041201ed7a3022db2ad062ad02320695f1e81370c4353998e097d4d85a794" exitCode=0
Sep 10 15:44:45.693153 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.692970    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"
Sep 10 15:44:45.693153 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.692979    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp" event={"ID":"08246df6-a688-48cf-8ff7-2fba5e44bc34","Type":"ContainerDied","Data":"480041201ed7a3022db2ad062ad02320695f1e81370c4353998e097d4d85a794"}
Sep 10 15:44:45.693153 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.693046    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp" event={"ID":"08246df6-a688-48cf-8ff7-2fba5e44bc34","Type":"ContainerDied","Data":"f899bad45b576e696921b2a0da3e7168611c6c9e81a9af4c475e57bce708ffa5"}
Sep 10 15:44:45.693153 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.693076    2574 scope.go:117] "RemoveContainer" containerID="480041201ed7a3022db2ad062ad02320695f1e81370c4353998e097d4d85a794"
Sep 10 15:44:45.703512 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.703497    2574 scope.go:117] "RemoveContainer" containerID="b5143f608519022da39e38fbc6267565d98a683395abb6fffc678239aacb8feb"
Sep 10 15:44:45.711489 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.711473    2574 scope.go:117] "RemoveContainer" containerID="480041201ed7a3022db2ad062ad02320695f1e81370c4353998e097d4d85a794"
Sep 10 15:44:45.711739 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:44:45.711721    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"480041201ed7a3022db2ad062ad02320695f1e81370c4353998e097d4d85a794\": container with ID starting with 480041201ed7a3022db2ad062ad02320695f1e81370c4353998e097d4d85a794 not found: ID does not exist" containerID="480041201ed7a3022db2ad062ad02320695f1e81370c4353998e097d4d85a794"
Sep 10 15:44:45.711789 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.711747    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"480041201ed7a3022db2ad062ad02320695f1e81370c4353998e097d4d85a794"} err="failed to get container status \"480041201ed7a3022db2ad062ad02320695f1e81370c4353998e097d4d85a794\": rpc error: code = NotFound desc = could not find container \"480041201ed7a3022db2ad062ad02320695f1e81370c4353998e097d4d85a794\": container with ID starting with 480041201ed7a3022db2ad062ad02320695f1e81370c4353998e097d4d85a794 not found: ID does not exist"
Sep 10 15:44:45.711789 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.711764    2574 scope.go:117] "RemoveContainer" containerID="b5143f608519022da39e38fbc6267565d98a683395abb6fffc678239aacb8feb"
Sep 10 15:44:45.712067 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:44:45.712047    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5143f608519022da39e38fbc6267565d98a683395abb6fffc678239aacb8feb\": container with ID starting with b5143f608519022da39e38fbc6267565d98a683395abb6fffc678239aacb8feb not found: ID does not exist" containerID="b5143f608519022da39e38fbc6267565d98a683395abb6fffc678239aacb8feb"
Sep 10 15:44:45.712687 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.712076    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5143f608519022da39e38fbc6267565d98a683395abb6fffc678239aacb8feb"} err="failed to get container status \"b5143f608519022da39e38fbc6267565d98a683395abb6fffc678239aacb8feb\": rpc error: code = NotFound desc = could not find container \"b5143f608519022da39e38fbc6267565d98a683395abb6fffc678239aacb8feb\": container with ID starting with b5143f608519022da39e38fbc6267565d98a683395abb6fffc678239aacb8feb not found: ID does not exist"
Sep 10 15:44:45.715506 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.715486    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"]
Sep 10 15:44:45.719667 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:45.719648    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-ba5c7e-openshift-default-788fb679cb-cp4vp"]
Sep 10 15:44:47.410164 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:47.410122    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08246df6-a688-48cf-8ff7-2fba5e44bc34" path="/var/lib/kubelet/pods/08246df6-a688-48cf-8ff7-2fba5e44bc34/volumes"
Sep 10 15:44:51.045408 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.045373    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"]
Sep 10 15:44:51.045788 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.045651    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42" podUID="8343eb81-28e0-4d76-8453-57b9ea929f14" containerName="maas-api" containerID="cri-o://bc33151d24459bea36c9c28396b23d49d3f3edc1e225776924132364d1830dae" gracePeriod=30
Sep 10 15:44:51.302210 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.302144    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"
Sep 10 15:44:51.387368 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.387326    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8343eb81-28e0-4d76-8453-57b9ea929f14-metrics-certs\") pod \"8343eb81-28e0-4d76-8453-57b9ea929f14\" (UID: \"8343eb81-28e0-4d76-8453-57b9ea929f14\") "
Sep 10 15:44:51.387561 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.387379    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8343eb81-28e0-4d76-8453-57b9ea929f14-maas-api-tls\") pod \"8343eb81-28e0-4d76-8453-57b9ea929f14\" (UID: \"8343eb81-28e0-4d76-8453-57b9ea929f14\") "
Sep 10 15:44:51.387561 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.387435    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8343eb81-28e0-4d76-8453-57b9ea929f14-openshift-service-ca\") pod \"8343eb81-28e0-4d76-8453-57b9ea929f14\" (UID: \"8343eb81-28e0-4d76-8453-57b9ea929f14\") "
Sep 10 15:44:51.387561 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.387495    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57mkt\" (UniqueName: \"kubernetes.io/projected/8343eb81-28e0-4d76-8453-57b9ea929f14-kube-api-access-57mkt\") pod \"8343eb81-28e0-4d76-8453-57b9ea929f14\" (UID: \"8343eb81-28e0-4d76-8453-57b9ea929f14\") "
Sep 10 15:44:51.387818 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.387783    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8343eb81-28e0-4d76-8453-57b9ea929f14-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8343eb81-28e0-4d76-8453-57b9ea929f14" (UID: "8343eb81-28e0-4d76-8453-57b9ea929f14"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:44:51.389649 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.389623    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8343eb81-28e0-4d76-8453-57b9ea929f14-kube-api-access-57mkt" (OuterVolumeSpecName: "kube-api-access-57mkt") pod "8343eb81-28e0-4d76-8453-57b9ea929f14" (UID: "8343eb81-28e0-4d76-8453-57b9ea929f14"). InnerVolumeSpecName "kube-api-access-57mkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:44:51.389748 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.389657    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8343eb81-28e0-4d76-8453-57b9ea929f14-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8343eb81-28e0-4d76-8453-57b9ea929f14" (UID: "8343eb81-28e0-4d76-8453-57b9ea929f14"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:44:51.389977 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.389920    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8343eb81-28e0-4d76-8453-57b9ea929f14-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8343eb81-28e0-4d76-8453-57b9ea929f14" (UID: "8343eb81-28e0-4d76-8453-57b9ea929f14"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:44:51.488759 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.488718    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8343eb81-28e0-4d76-8453-57b9ea929f14-metrics-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:44:51.488759 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.488756    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8343eb81-28e0-4d76-8453-57b9ea929f14-maas-api-tls\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:44:51.488759 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.488772    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8343eb81-28e0-4d76-8453-57b9ea929f14-openshift-service-ca\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:44:51.489086 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.488786    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57mkt\" (UniqueName: \"kubernetes.io/projected/8343eb81-28e0-4d76-8453-57b9ea929f14-kube-api-access-57mkt\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:44:51.728384 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.728293    2574 generic.go:356] "Generic (PLEG): container finished" podID="8343eb81-28e0-4d76-8453-57b9ea929f14" containerID="bc33151d24459bea36c9c28396b23d49d3f3edc1e225776924132364d1830dae" exitCode=0
Sep 10 15:44:51.728384 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.728339    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"
Sep 10 15:44:51.728384 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.728355    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42" event={"ID":"8343eb81-28e0-4d76-8453-57b9ea929f14","Type":"ContainerDied","Data":"bc33151d24459bea36c9c28396b23d49d3f3edc1e225776924132364d1830dae"}
Sep 10 15:44:51.728635 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.728395    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42" event={"ID":"8343eb81-28e0-4d76-8453-57b9ea929f14","Type":"ContainerDied","Data":"0d2c47f4282394c8dea64c1228b26e93961dafb3dbf3e20ff8a02220fef38b46"}
Sep 10 15:44:51.728635 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.728417    2574 scope.go:117] "RemoveContainer" containerID="bc33151d24459bea36c9c28396b23d49d3f3edc1e225776924132364d1830dae"
Sep 10 15:44:51.737884 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.737848    2574 scope.go:117] "RemoveContainer" containerID="bc33151d24459bea36c9c28396b23d49d3f3edc1e225776924132364d1830dae"
Sep 10 15:44:51.738170 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:44:51.738150    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc33151d24459bea36c9c28396b23d49d3f3edc1e225776924132364d1830dae\": container with ID starting with bc33151d24459bea36c9c28396b23d49d3f3edc1e225776924132364d1830dae not found: ID does not exist" containerID="bc33151d24459bea36c9c28396b23d49d3f3edc1e225776924132364d1830dae"
Sep 10 15:44:51.738211 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.738179    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc33151d24459bea36c9c28396b23d49d3f3edc1e225776924132364d1830dae"} err="failed to get container status \"bc33151d24459bea36c9c28396b23d49d3f3edc1e225776924132364d1830dae\": rpc error: code = NotFound desc = could not find container \"bc33151d24459bea36c9c28396b23d49d3f3edc1e225776924132364d1830dae\": container with ID starting with bc33151d24459bea36c9c28396b23d49d3f3edc1e225776924132364d1830dae not found: ID does not exist"
Sep 10 15:44:51.746372 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.746349    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"]
Sep 10 15:44:51.751526 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:51.751503    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-09b833-869dd76cc5-p4z42"]
Sep 10 15:44:53.409435 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:53.409401    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8343eb81-28e0-4d76-8453-57b9ea929f14" path="/var/lib/kubelet/pods/8343eb81-28e0-4d76-8453-57b9ea929f14/volumes"
Sep 10 15:44:58.050133 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.050094    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"]
Sep 10 15:44:58.050613 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.050367    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn" podUID="3bc600ed-89fd-4866-8a9c-e864b01c43d7" containerName="istio-proxy" containerID="cri-o://416efb0ae87b38eb0cd5368f522744c9ec65cf5657298c692c10866063cc0bc5" gracePeriod=30
Sep 10 15:44:58.405922 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.405844    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-62d2f7-tq55n"]
Sep 10 15:44:58.406224 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.406211    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08246df6-a688-48cf-8ff7-2fba5e44bc34" containerName="istio-proxy"
Sep 10 15:44:58.406284 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.406226    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="08246df6-a688-48cf-8ff7-2fba5e44bc34" containerName="istio-proxy"
Sep 10 15:44:58.406284 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.406245    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" containerName="istio-proxy"
Sep 10 15:44:58.406284 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.406251    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" containerName="istio-proxy"
Sep 10 15:44:58.406284 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.406266    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8343eb81-28e0-4d76-8453-57b9ea929f14" containerName="maas-api"
Sep 10 15:44:58.406284 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.406273    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8343eb81-28e0-4d76-8453-57b9ea929f14" containerName="maas-api"
Sep 10 15:44:58.406284 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.406281    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce97193-c7fe-4a32-8774-69cea736fbb4" containerName="maas-api"
Sep 10 15:44:58.406284 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.406286    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce97193-c7fe-4a32-8774-69cea736fbb4" containerName="maas-api"
Sep 10 15:44:58.406503 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.406300    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" containerName="istio-proxy"
Sep 10 15:44:58.406503 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.406305    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" containerName="istio-proxy"
Sep 10 15:44:58.406503 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.406359    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" containerName="istio-proxy"
Sep 10 15:44:58.406503 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.406369    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="08246df6-a688-48cf-8ff7-2fba5e44bc34" containerName="istio-proxy"
Sep 10 15:44:58.406503 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.406374    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ce97193-c7fe-4a32-8774-69cea736fbb4" containerName="maas-api"
Sep 10 15:44:58.406503 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.406379    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="08246df6-a688-48cf-8ff7-2fba5e44bc34" containerName="istio-proxy"
Sep 10 15:44:58.406503 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.406384    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e50c6e34-d5b6-44a3-9d28-5ea4f9978e5b" containerName="istio-proxy"
Sep 10 15:44:58.406503 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.406389    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8343eb81-28e0-4d76-8453-57b9ea929f14" containerName="maas-api"
Sep 10 15:44:58.410800 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.410780    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-62d2f7-tq55n"
Sep 10 15:44:58.413240 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.413194    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zzl2g\""
Sep 10 15:44:58.413491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.413475    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 15:44:58.420460 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.420436    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-62d2f7-tq55n"]
Sep 10 15:44:58.448891 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.448852    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0a8f613-ad49-49fd-8218-e82dd4f47221-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-62d2f7-tq55n\" (UID: \"f0a8f613-ad49-49fd-8218-e82dd4f47221\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-62d2f7-tq55n"
Sep 10 15:44:58.550211 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.550170    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0a8f613-ad49-49fd-8218-e82dd4f47221-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-62d2f7-tq55n\" (UID: \"f0a8f613-ad49-49fd-8218-e82dd4f47221\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-62d2f7-tq55n"
Sep 10 15:44:58.550768 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.550750    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0a8f613-ad49-49fd-8218-e82dd4f47221-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-62d2f7-tq55n\" (UID: \"f0a8f613-ad49-49fd-8218-e82dd4f47221\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-62d2f7-tq55n"
Sep 10 15:44:58.723317 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.723228    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-62d2f7-tq55n"
Sep 10 15:44:58.995998 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:58.995968    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-62d2f7-tq55n"]
Sep 10 15:44:58.998333 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:44:58.998302    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0a8f613_ad49_49fd_8218_e82dd4f47221.slice/crio-8f5313b912e49cf6891030128425c982bac9bd1d39674afa9a1439aa77089534 WatchSource:0}: Error finding container 8f5313b912e49cf6891030128425c982bac9bd1d39674afa9a1439aa77089534: Status 404 returned error can't find the container with id 8f5313b912e49cf6891030128425c982bac9bd1d39674afa9a1439aa77089534
Sep 10 15:44:59.777012 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:59.776983    2574 generic.go:356] "Generic (PLEG): container finished" podID="f0a8f613-ad49-49fd-8218-e82dd4f47221" containerID="c6189ec398991ef17182a45fcb9af6fb2a19e618e46b2177660d71691c0df357" exitCode=0
Sep 10 15:44:59.777346 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:59.777071    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-62d2f7-tq55n" event={"ID":"f0a8f613-ad49-49fd-8218-e82dd4f47221","Type":"ContainerDied","Data":"c6189ec398991ef17182a45fcb9af6fb2a19e618e46b2177660d71691c0df357"}
Sep 10 15:44:59.777346 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:44:59.777121    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-62d2f7-tq55n" event={"ID":"f0a8f613-ad49-49fd-8218-e82dd4f47221","Type":"ContainerStarted","Data":"8f5313b912e49cf6891030128425c982bac9bd1d39674afa9a1439aa77089534"}
Sep 10 15:45:00.133694 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:00.133656    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-62d2f7-29817585-6t5sp"]
Sep 10 15:45:00.134076 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:00.134063    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08246df6-a688-48cf-8ff7-2fba5e44bc34" containerName="istio-proxy"
Sep 10 15:45:00.134076 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:00.134078    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="08246df6-a688-48cf-8ff7-2fba5e44bc34" containerName="istio-proxy"
Sep 10 15:45:00.137177 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:00.137162    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-62d2f7-29817585-6t5sp"
Sep 10 15:45:00.146876 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:00.146840    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-62d2f7-29817585-6t5sp"]
Sep 10 15:45:00.149191 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:00.149168    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-62d2f7-29817585-6t5sp"
Sep 10 15:45:00.421403 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:00.421375    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-62d2f7-29817585-6t5sp"]
Sep 10 15:45:00.422716 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:45:00.422690    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6f43cf6_b6c9_487b_89d7_51cf47c850fb.slice/crio-ad34412ce624f85405a1e01be537912a051324ac3f203a5fe564c720fc0eca79 WatchSource:0}: Error finding container ad34412ce624f85405a1e01be537912a051324ac3f203a5fe564c720fc0eca79: Status 404 returned error can't find the container with id ad34412ce624f85405a1e01be537912a051324ac3f203a5fe564c720fc0eca79
Sep 10 15:45:00.784965 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:00.784843    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-62d2f7-29817585-6t5sp" event={"ID":"b6f43cf6-b6c9-487b-89d7-51cf47c850fb","Type":"ContainerStarted","Data":"2e638e81020b5744537a7f4403804a269fc96c3e1dbc4533c9de039083b5157b"}
Sep 10 15:45:00.784965 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:00.784913    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-62d2f7-29817585-6t5sp" event={"ID":"b6f43cf6-b6c9-487b-89d7-51cf47c850fb","Type":"ContainerStarted","Data":"ad34412ce624f85405a1e01be537912a051324ac3f203a5fe564c720fc0eca79"}
Sep 10 15:45:00.801975 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:00.801908    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-62d2f7-29817585-6t5sp" podStartSLOduration=0.801890346 podStartE2EDuration="801.890346ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:45:00.798970998 +0000 UTC m=+1753.848769528" watchObservedRunningTime="2026-09-10 15:45:00.801890346 +0000 UTC m=+1753.851688868"
Sep 10 15:45:00.917046 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:00.917021    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-62d2f7-tq55n"
Sep 10 15:45:00.981292 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:00.981259    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0a8f613-ad49-49fd-8218-e82dd4f47221-maas-api-service-ca\") pod \"f0a8f613-ad49-49fd-8218-e82dd4f47221\" (UID: \"f0a8f613-ad49-49fd-8218-e82dd4f47221\") "
Sep 10 15:45:00.981604 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:00.981582    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0a8f613-ad49-49fd-8218-e82dd4f47221-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f0a8f613-ad49-49fd-8218-e82dd4f47221" (UID: "f0a8f613-ad49-49fd-8218-e82dd4f47221"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:45:01.082197 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:01.082158    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0a8f613-ad49-49fd-8218-e82dd4f47221-maas-api-service-ca\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:45:01.791984 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:01.791956    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-62d2f7-tq55n"
Sep 10 15:45:01.792414 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:01.791958    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-62d2f7-tq55n" event={"ID":"f0a8f613-ad49-49fd-8218-e82dd4f47221","Type":"ContainerDied","Data":"8f5313b912e49cf6891030128425c982bac9bd1d39674afa9a1439aa77089534"}
Sep 10 15:45:01.792414 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:01.792081    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f5313b912e49cf6891030128425c982bac9bd1d39674afa9a1439aa77089534"
Sep 10 15:45:01.793625 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:01.793600    2574 generic.go:356] "Generic (PLEG): container finished" podID="b6f43cf6-b6c9-487b-89d7-51cf47c850fb" containerID="2e638e81020b5744537a7f4403804a269fc96c3e1dbc4533c9de039083b5157b" exitCode=0
Sep 10 15:45:01.793754 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:01.793685    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-62d2f7-29817585-6t5sp" event={"ID":"b6f43cf6-b6c9-487b-89d7-51cf47c850fb","Type":"ContainerDied","Data":"2e638e81020b5744537a7f4403804a269fc96c3e1dbc4533c9de039083b5157b"}
Sep 10 15:45:02.932110 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:02.932086    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-62d2f7-29817585-6t5sp"
Sep 10 15:45:03.295002 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.294977    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:45:03.403677 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.403577    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-workload-socket\") pod \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") "
Sep 10 15:45:03.403677 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.403648    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-podinfo\") pod \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") "
Sep 10 15:45:03.403919 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.403694    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-envoy\") pod \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") "
Sep 10 15:45:03.403919 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.403716    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-data\") pod \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") "
Sep 10 15:45:03.403919 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.403779    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-workload-certs\") pod \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") "
Sep 10 15:45:03.403919 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.403803    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5djm\" (UniqueName: \"kubernetes.io/projected/3bc600ed-89fd-4866-8a9c-e864b01c43d7-kube-api-access-x5djm\") pod \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") "
Sep 10 15:45:03.403919 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.403831    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istiod-ca-cert\") pod \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") "
Sep 10 15:45:03.403919 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.403868    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-credential-socket\") pod \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") "
Sep 10 15:45:03.403919 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.403873    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3bc600ed-89fd-4866-8a9c-e864b01c43d7" (UID: "3bc600ed-89fd-4866-8a9c-e864b01c43d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:45:03.403919 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.403909    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-token\") pod \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\" (UID: \"3bc600ed-89fd-4866-8a9c-e864b01c43d7\") "
Sep 10 15:45:03.404405 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.404067    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-data" (OuterVolumeSpecName: "istio-data") pod "3bc600ed-89fd-4866-8a9c-e864b01c43d7" (UID: "3bc600ed-89fd-4866-8a9c-e864b01c43d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:45:03.404405 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.404082    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3bc600ed-89fd-4866-8a9c-e864b01c43d7" (UID: "3bc600ed-89fd-4866-8a9c-e864b01c43d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:45:03.404405 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.404244    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3bc600ed-89fd-4866-8a9c-e864b01c43d7" (UID: "3bc600ed-89fd-4866-8a9c-e864b01c43d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:45:03.404405 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.404299    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3bc600ed-89fd-4866-8a9c-e864b01c43d7" (UID: "3bc600ed-89fd-4866-8a9c-e864b01c43d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:45:03.404405 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.404343    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-workload-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:45:03.404405 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.404362    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-data\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:45:03.404405 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.404372    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-workload-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:45:03.404405 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.404383    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-credential-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:45:03.406091 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.406058    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-token" (OuterVolumeSpecName: "istio-token") pod "3bc600ed-89fd-4866-8a9c-e864b01c43d7" (UID: "3bc600ed-89fd-4866-8a9c-e864b01c43d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:45:03.406223 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.406198    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bc600ed-89fd-4866-8a9c-e864b01c43d7-kube-api-access-x5djm" (OuterVolumeSpecName: "kube-api-access-x5djm") pod "3bc600ed-89fd-4866-8a9c-e864b01c43d7" (UID: "3bc600ed-89fd-4866-8a9c-e864b01c43d7"). InnerVolumeSpecName "kube-api-access-x5djm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:45:03.406313 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.406298    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3bc600ed-89fd-4866-8a9c-e864b01c43d7" (UID: "3bc600ed-89fd-4866-8a9c-e864b01c43d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:45:03.406360 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.406334    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3bc600ed-89fd-4866-8a9c-e864b01c43d7" (UID: "3bc600ed-89fd-4866-8a9c-e864b01c43d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:45:03.505648 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.505610    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-podinfo\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:45:03.505648 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.505641    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-envoy\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:45:03.505648 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.505650    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5djm\" (UniqueName: \"kubernetes.io/projected/3bc600ed-89fd-4866-8a9c-e864b01c43d7-kube-api-access-x5djm\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:45:03.505892 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.505663    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istiod-ca-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:45:03.505892 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.505671    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bc600ed-89fd-4866-8a9c-e864b01c43d7-istio-token\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:45:03.806888 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.806855    2574 generic.go:356] "Generic (PLEG): container finished" podID="3bc600ed-89fd-4866-8a9c-e864b01c43d7" containerID="416efb0ae87b38eb0cd5368f522744c9ec65cf5657298c692c10866063cc0bc5" exitCode=0
Sep 10 15:45:03.807077 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.806908    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"
Sep 10 15:45:03.807077 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.806969    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn" event={"ID":"3bc600ed-89fd-4866-8a9c-e864b01c43d7","Type":"ContainerDied","Data":"416efb0ae87b38eb0cd5368f522744c9ec65cf5657298c692c10866063cc0bc5"}
Sep 10 15:45:03.807077 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.807022    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn" event={"ID":"3bc600ed-89fd-4866-8a9c-e864b01c43d7","Type":"ContainerDied","Data":"e18d5ffe5e5e7cf52d49d1fb9156ce0a2e41acdf7062dca778fac104de404aab"}
Sep 10 15:45:03.807077 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.807057    2574 scope.go:117] "RemoveContainer" containerID="416efb0ae87b38eb0cd5368f522744c9ec65cf5657298c692c10866063cc0bc5"
Sep 10 15:45:03.808529 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.808507    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-62d2f7-29817585-6t5sp" event={"ID":"b6f43cf6-b6c9-487b-89d7-51cf47c850fb","Type":"ContainerDied","Data":"ad34412ce624f85405a1e01be537912a051324ac3f203a5fe564c720fc0eca79"}
Sep 10 15:45:03.808529 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.808527    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-62d2f7-29817585-6t5sp"
Sep 10 15:45:03.808683 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.808553    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad34412ce624f85405a1e01be537912a051324ac3f203a5fe564c720fc0eca79"
Sep 10 15:45:03.816969 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.816951    2574 scope.go:117] "RemoveContainer" containerID="3b6a5eca5017688ce6b4eda540575b3e4275dd450039c2cfa231ebfdad5ccc34"
Sep 10 15:45:03.832870 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.832846    2574 scope.go:117] "RemoveContainer" containerID="416efb0ae87b38eb0cd5368f522744c9ec65cf5657298c692c10866063cc0bc5"
Sep 10 15:45:03.833432 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:45:03.833405    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"416efb0ae87b38eb0cd5368f522744c9ec65cf5657298c692c10866063cc0bc5\": container with ID starting with 416efb0ae87b38eb0cd5368f522744c9ec65cf5657298c692c10866063cc0bc5 not found: ID does not exist" containerID="416efb0ae87b38eb0cd5368f522744c9ec65cf5657298c692c10866063cc0bc5"
Sep 10 15:45:03.833573 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.833444    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"416efb0ae87b38eb0cd5368f522744c9ec65cf5657298c692c10866063cc0bc5"} err="failed to get container status \"416efb0ae87b38eb0cd5368f522744c9ec65cf5657298c692c10866063cc0bc5\": rpc error: code = NotFound desc = could not find container \"416efb0ae87b38eb0cd5368f522744c9ec65cf5657298c692c10866063cc0bc5\": container with ID starting with 416efb0ae87b38eb0cd5368f522744c9ec65cf5657298c692c10866063cc0bc5 not found: ID does not exist"
Sep 10 15:45:03.833573 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.833472    2574 scope.go:117] "RemoveContainer" containerID="3b6a5eca5017688ce6b4eda540575b3e4275dd450039c2cfa231ebfdad5ccc34"
Sep 10 15:45:03.834051 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:45:03.834022    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b6a5eca5017688ce6b4eda540575b3e4275dd450039c2cfa231ebfdad5ccc34\": container with ID starting with 3b6a5eca5017688ce6b4eda540575b3e4275dd450039c2cfa231ebfdad5ccc34 not found: ID does not exist" containerID="3b6a5eca5017688ce6b4eda540575b3e4275dd450039c2cfa231ebfdad5ccc34"
Sep 10 15:45:03.834195 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.834058    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b6a5eca5017688ce6b4eda540575b3e4275dd450039c2cfa231ebfdad5ccc34"} err="failed to get container status \"3b6a5eca5017688ce6b4eda540575b3e4275dd450039c2cfa231ebfdad5ccc34\": rpc error: code = NotFound desc = could not find container \"3b6a5eca5017688ce6b4eda540575b3e4275dd450039c2cfa231ebfdad5ccc34\": container with ID starting with 3b6a5eca5017688ce6b4eda540575b3e4275dd450039c2cfa231ebfdad5ccc34 not found: ID does not exist"
Sep 10 15:45:03.834853 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.834831    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"]
Sep 10 15:45:03.837536 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:03.837515    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-09b833-openshift-default-f59bc8578-8h6kn"]
Sep 10 15:45:05.409851 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:05.409818    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bc600ed-89fd-4866-8a9c-e864b01c43d7" path="/var/lib/kubelet/pods/3bc600ed-89fd-4866-8a9c-e864b01c43d7/volumes"
Sep 10 15:45:08.838520 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:08.838486    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-62d2f7-29817585-6t5sp"]
Sep 10 15:45:08.843146 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:08.843120    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-62d2f7-29817585-6t5sp"]
Sep 10 15:45:08.999917 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:08.999882    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-62d2f7-tq55n"]
Sep 10 15:45:09.002187 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:09.002165    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-62d2f7-tq55n"]
Sep 10 15:45:09.409336 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:09.409305    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6f43cf6-b6c9-487b-89d7-51cf47c850fb" path="/var/lib/kubelet/pods/b6f43cf6-b6c9-487b-89d7-51cf47c850fb/volumes"
Sep 10 15:45:09.409627 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:09.409614    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0a8f613-ad49-49fd-8218-e82dd4f47221" path="/var/lib/kubelet/pods/f0a8f613-ad49-49fd-8218-e82dd4f47221/volumes"
Sep 10 15:45:15.980360 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:15.980329    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fc3e54-727xc"]
Sep 10 15:45:15.980876 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:15.980716    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bc600ed-89fd-4866-8a9c-e864b01c43d7" containerName="istio-proxy"
Sep 10 15:45:15.980876 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:15.980731    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bc600ed-89fd-4866-8a9c-e864b01c43d7" containerName="istio-proxy"
Sep 10 15:45:15.980876 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:15.980740    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bc600ed-89fd-4866-8a9c-e864b01c43d7" containerName="istio-proxy"
Sep 10 15:45:15.980876 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:15.980746    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bc600ed-89fd-4866-8a9c-e864b01c43d7" containerName="istio-proxy"
Sep 10 15:45:15.980876 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:15.980764    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a8f613-ad49-49fd-8218-e82dd4f47221" containerName="revoke-keys"
Sep 10 15:45:15.980876 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:15.980769    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a8f613-ad49-49fd-8218-e82dd4f47221" containerName="revoke-keys"
Sep 10 15:45:15.980876 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:15.980775    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6f43cf6-b6c9-487b-89d7-51cf47c850fb" containerName="cleanup"
Sep 10 15:45:15.980876 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:15.980779    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6f43cf6-b6c9-487b-89d7-51cf47c850fb" containerName="cleanup"
Sep 10 15:45:15.980876 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:15.980836    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bc600ed-89fd-4866-8a9c-e864b01c43d7" containerName="istio-proxy"
Sep 10 15:45:15.980876 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:15.980845    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0a8f613-ad49-49fd-8218-e82dd4f47221" containerName="revoke-keys"
Sep 10 15:45:15.980876 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:15.980851    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6f43cf6-b6c9-487b-89d7-51cf47c850fb" containerName="cleanup"
Sep 10 15:45:15.980876 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:15.980856    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bc600ed-89fd-4866-8a9c-e864b01c43d7" containerName="istio-proxy"
Sep 10 15:45:15.985638 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:15.985621    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fc3e54-727xc"
Sep 10 15:45:15.989705 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:15.989684    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zzl2g\""
Sep 10 15:45:15.989977 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:15.989961    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 15:45:16.007983 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:16.007953    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fc3e54-727xc"]
Sep 10 15:45:16.126085 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:16.126045    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/629d12de-0ead-4be6-817c-b6413d4a76d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-fc3e54-727xc\" (UID: \"629d12de-0ead-4be6-817c-b6413d4a76d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fc3e54-727xc"
Sep 10 15:45:16.226805 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:16.226766    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/629d12de-0ead-4be6-817c-b6413d4a76d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-fc3e54-727xc\" (UID: \"629d12de-0ead-4be6-817c-b6413d4a76d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fc3e54-727xc"
Sep 10 15:45:16.227425 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:16.227403    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/629d12de-0ead-4be6-817c-b6413d4a76d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-fc3e54-727xc\" (UID: \"629d12de-0ead-4be6-817c-b6413d4a76d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fc3e54-727xc"
Sep 10 15:45:16.296035 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:16.296005    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fc3e54-727xc"
Sep 10 15:45:16.567729 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:16.567702    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fc3e54-727xc"]
Sep 10 15:45:16.569394 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:45:16.569366    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod629d12de_0ead_4be6_817c_b6413d4a76d9.slice/crio-37c165dab29e949ec366a5ed2b2cc58e3cc740f6b597bd2bb5b1194eb899fa1e WatchSource:0}: Error finding container 37c165dab29e949ec366a5ed2b2cc58e3cc740f6b597bd2bb5b1194eb899fa1e: Status 404 returned error can't find the container with id 37c165dab29e949ec366a5ed2b2cc58e3cc740f6b597bd2bb5b1194eb899fa1e
Sep 10 15:45:16.886776 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:16.886674    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fc3e54-727xc" event={"ID":"629d12de-0ead-4be6-817c-b6413d4a76d9","Type":"ContainerStarted","Data":"75491daa004b2548b5bb652ea4dc521ce0fac219f4e7e23a6c00c2e6796ff048"}
Sep 10 15:45:16.886776 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:16.886734    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fc3e54-727xc" event={"ID":"629d12de-0ead-4be6-817c-b6413d4a76d9","Type":"ContainerStarted","Data":"37c165dab29e949ec366a5ed2b2cc58e3cc740f6b597bd2bb5b1194eb899fa1e"}
Sep 10 15:45:16.902131 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:16.902084    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fc3e54-727xc" podStartSLOduration=1.9020718840000002 podStartE2EDuration="1.902071884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:45:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:45:16.900642399 +0000 UTC m=+1769.950440907" watchObservedRunningTime="2026-09-10 15:45:16.902071884 +0000 UTC m=+1769.951870392"
Sep 10 15:45:17.894051 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:17.894009    2574 generic.go:356] "Generic (PLEG): container finished" podID="629d12de-0ead-4be6-817c-b6413d4a76d9" containerID="75491daa004b2548b5bb652ea4dc521ce0fac219f4e7e23a6c00c2e6796ff048" exitCode=0
Sep 10 15:45:17.894455 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:17.894092    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fc3e54-727xc" event={"ID":"629d12de-0ead-4be6-817c-b6413d4a76d9","Type":"ContainerDied","Data":"75491daa004b2548b5bb652ea4dc521ce0fac219f4e7e23a6c00c2e6796ff048"}
Sep 10 15:45:19.033692 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:19.033661    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fc3e54-727xc"
Sep 10 15:45:19.152344 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:19.152251    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/629d12de-0ead-4be6-817c-b6413d4a76d9-maas-api-service-ca\") pod \"629d12de-0ead-4be6-817c-b6413d4a76d9\" (UID: \"629d12de-0ead-4be6-817c-b6413d4a76d9\") "
Sep 10 15:45:19.152669 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:19.152647    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/629d12de-0ead-4be6-817c-b6413d4a76d9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "629d12de-0ead-4be6-817c-b6413d4a76d9" (UID: "629d12de-0ead-4be6-817c-b6413d4a76d9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:45:19.253633 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:19.253595    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/629d12de-0ead-4be6-817c-b6413d4a76d9-maas-api-service-ca\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:45:19.907227 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:19.907195    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fc3e54-727xc"
Sep 10 15:45:19.907422 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:19.907245    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fc3e54-727xc" event={"ID":"629d12de-0ead-4be6-817c-b6413d4a76d9","Type":"ContainerDied","Data":"37c165dab29e949ec366a5ed2b2cc58e3cc740f6b597bd2bb5b1194eb899fa1e"}
Sep 10 15:45:19.907422 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:19.907309    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37c165dab29e949ec366a5ed2b2cc58e3cc740f6b597bd2bb5b1194eb899fa1e"
Sep 10 15:45:26.700958 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:26.700898    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fc3e54-727xc"]
Sep 10 15:45:26.704612 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:26.704589    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fc3e54-727xc"]
Sep 10 15:45:27.410218 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:27.410187    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="629d12de-0ead-4be6-817c-b6413d4a76d9" path="/var/lib/kubelet/pods/629d12de-0ead-4be6-817c-b6413d4a76d9/volumes"
Sep 10 15:45:33.216446 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:33.216411    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"]
Sep 10 15:45:33.217004 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:33.216635    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk" podUID="0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" containerName="istio-proxy" containerID="cri-o://46be5740774c80c821230801cc005e082cb0b3e160d8f38fe864b2922e8578b0" gracePeriod=30
Sep 10 15:45:38.470960 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.470914    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:45:38.527996 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.527878    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-workload-certs\") pod \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") "
Sep 10 15:45:38.527996 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.527983    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-data\") pod \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") "
Sep 10 15:45:38.528230 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.528024    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istiod-ca-cert\") pod \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") "
Sep 10 15:45:38.528230 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.528110    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-podinfo\") pod \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") "
Sep 10 15:45:38.528230 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.528139    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-token\") pod \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") "
Sep 10 15:45:38.528230 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.528175    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-credential-socket\") pod \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") "
Sep 10 15:45:38.528230 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.528204    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-envoy\") pod \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") "
Sep 10 15:45:38.528500 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.528274    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-workload-socket\") pod \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") "
Sep 10 15:45:38.528500 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.528195    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" (UID: "0f4bd0ed-10e1-416a-8ceb-d209b5a0035d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:45:38.528500 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.528313    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9bc6\" (UniqueName: \"kubernetes.io/projected/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-kube-api-access-x9bc6\") pod \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\" (UID: \"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d\") "
Sep 10 15:45:38.528631 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.528282    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-data" (OuterVolumeSpecName: "istio-data") pod "0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" (UID: "0f4bd0ed-10e1-416a-8ceb-d209b5a0035d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:45:38.528631 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.528394    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" (UID: "0f4bd0ed-10e1-416a-8ceb-d209b5a0035d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:45:38.528631 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.528515    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" (UID: "0f4bd0ed-10e1-416a-8ceb-d209b5a0035d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:45:38.528755 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.528666    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-credential-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:45:38.528755 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.528689    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-workload-socket\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:45:38.528755 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.528705    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-workload-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:45:38.528755 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.528720    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-data\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:45:38.529124 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.529098    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" (UID: "0f4bd0ed-10e1-416a-8ceb-d209b5a0035d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:45:38.531167 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.531133    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" (UID: "0f4bd0ed-10e1-416a-8ceb-d209b5a0035d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:45:38.531282 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.531170    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-token" (OuterVolumeSpecName: "istio-token") pod "0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" (UID: "0f4bd0ed-10e1-416a-8ceb-d209b5a0035d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:45:38.531282 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.531241    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" (UID: "0f4bd0ed-10e1-416a-8ceb-d209b5a0035d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:45:38.531366 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.531296    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-kube-api-access-x9bc6" (OuterVolumeSpecName: "kube-api-access-x9bc6") pod "0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" (UID: "0f4bd0ed-10e1-416a-8ceb-d209b5a0035d"). InnerVolumeSpecName "kube-api-access-x9bc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:45:38.630369 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.630328    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istiod-ca-cert\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:45:38.630369 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.630370    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-podinfo\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:45:38.630593 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.630384    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-token\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:45:38.630593 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.630397    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-istio-envoy\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:45:38.630593 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:38.630410    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9bc6\" (UniqueName: \"kubernetes.io/projected/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d-kube-api-access-x9bc6\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:45:39.012652 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:39.012617    2574 generic.go:356] "Generic (PLEG): container finished" podID="0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" containerID="46be5740774c80c821230801cc005e082cb0b3e160d8f38fe864b2922e8578b0" exitCode=0
Sep 10 15:45:39.012811 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:39.012674    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"
Sep 10 15:45:39.012811 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:39.012693    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk" event={"ID":"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d","Type":"ContainerDied","Data":"46be5740774c80c821230801cc005e082cb0b3e160d8f38fe864b2922e8578b0"}
Sep 10 15:45:39.012811 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:39.012743    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk" event={"ID":"0f4bd0ed-10e1-416a-8ceb-d209b5a0035d","Type":"ContainerDied","Data":"33708cb243666bdd58105e2776672d0aefef7cdee104031c492e69dbd015db9a"}
Sep 10 15:45:39.012811 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:39.012766    2574 scope.go:117] "RemoveContainer" containerID="46be5740774c80c821230801cc005e082cb0b3e160d8f38fe864b2922e8578b0"
Sep 10 15:45:39.022495 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:39.022480    2574 scope.go:117] "RemoveContainer" containerID="29462e2d9fdb8b640cd2077766d9ab14eb07b27df5125804ed3d8472ad3a3619"
Sep 10 15:45:39.031340 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:39.031320    2574 scope.go:117] "RemoveContainer" containerID="46be5740774c80c821230801cc005e082cb0b3e160d8f38fe864b2922e8578b0"
Sep 10 15:45:39.031705 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:45:39.031671    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46be5740774c80c821230801cc005e082cb0b3e160d8f38fe864b2922e8578b0\": container with ID starting with 46be5740774c80c821230801cc005e082cb0b3e160d8f38fe864b2922e8578b0 not found: ID does not exist" containerID="46be5740774c80c821230801cc005e082cb0b3e160d8f38fe864b2922e8578b0"
Sep 10 15:45:39.031822 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:39.031712    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46be5740774c80c821230801cc005e082cb0b3e160d8f38fe864b2922e8578b0"} err="failed to get container status \"46be5740774c80c821230801cc005e082cb0b3e160d8f38fe864b2922e8578b0\": rpc error: code = NotFound desc = could not find container \"46be5740774c80c821230801cc005e082cb0b3e160d8f38fe864b2922e8578b0\": container with ID starting with 46be5740774c80c821230801cc005e082cb0b3e160d8f38fe864b2922e8578b0 not found: ID does not exist"
Sep 10 15:45:39.031822 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:39.031731    2574 scope.go:117] "RemoveContainer" containerID="29462e2d9fdb8b640cd2077766d9ab14eb07b27df5125804ed3d8472ad3a3619"
Sep 10 15:45:39.032087 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:45:39.032067    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29462e2d9fdb8b640cd2077766d9ab14eb07b27df5125804ed3d8472ad3a3619\": container with ID starting with 29462e2d9fdb8b640cd2077766d9ab14eb07b27df5125804ed3d8472ad3a3619 not found: ID does not exist" containerID="29462e2d9fdb8b640cd2077766d9ab14eb07b27df5125804ed3d8472ad3a3619"
Sep 10 15:45:39.032164 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:39.032095    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29462e2d9fdb8b640cd2077766d9ab14eb07b27df5125804ed3d8472ad3a3619"} err="failed to get container status \"29462e2d9fdb8b640cd2077766d9ab14eb07b27df5125804ed3d8472ad3a3619\": rpc error: code = NotFound desc = could not find container \"29462e2d9fdb8b640cd2077766d9ab14eb07b27df5125804ed3d8472ad3a3619\": container with ID starting with 29462e2d9fdb8b640cd2077766d9ab14eb07b27df5125804ed3d8472ad3a3619 not found: ID does not exist"
Sep 10 15:45:39.034428 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:39.034405    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"]
Sep 10 15:45:39.037862 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:39.037843    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-fc3e54-openshift-default-556db469db-4n9jk"]
Sep 10 15:45:39.410958 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:39.410894    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" path="/var/lib/kubelet/pods/0f4bd0ed-10e1-416a-8ceb-d209b5a0035d/volumes"
Sep 10 15:45:47.521821 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:47.521785    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/2.log"
Sep 10 15:45:47.532436 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:45:47.532413    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/2.log"
Sep 10 15:46:49.046632 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:46:49.046595    2574 scope.go:117] "RemoveContainer" containerID="48b249518465f43329d774006e69e471a76aece0e7a76c102e8e9ca590e91e39"
Sep 10 15:46:49.055542 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:46:49.055520    2574 scope.go:117] "RemoveContainer" containerID="5d3370978af4a0a78a262f59a7ee78a0a0835784c83d538f26de23aa9b9b9fa1"
Sep 10 15:50:47.559492 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:50:47.559464    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/2.log"
Sep 10 15:50:47.569913 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:50:47.569891    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/2.log"
Sep 10 15:51:17.430650 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.430618    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-788d559bf-h2w55"]
Sep 10 15:51:17.431216 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.430969    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" containerName="istio-proxy"
Sep 10 15:51:17.431216 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.430981    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" containerName="istio-proxy"
Sep 10 15:51:17.431216 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.430991    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" containerName="istio-proxy"
Sep 10 15:51:17.431216 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.430997    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" containerName="istio-proxy"
Sep 10 15:51:17.431216 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.431004    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="629d12de-0ead-4be6-817c-b6413d4a76d9" containerName="revoke-keys"
Sep 10 15:51:17.431216 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.431009    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="629d12de-0ead-4be6-817c-b6413d4a76d9" containerName="revoke-keys"
Sep 10 15:51:17.431216 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.431066    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" containerName="istio-proxy"
Sep 10 15:51:17.431216 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.431074    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="629d12de-0ead-4be6-817c-b6413d4a76d9" containerName="revoke-keys"
Sep 10 15:51:17.431216 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.431083    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f4bd0ed-10e1-416a-8ceb-d209b5a0035d" containerName="istio-proxy"
Sep 10 15:51:17.434110 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.434093    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55"
Sep 10 15:51:17.437167 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.437146    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 15:51:17.438546 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.438526    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 15:51:17.438685 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.438563    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 15:51:17.438786 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.438760    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gljcp\""
Sep 10 15:51:17.438901 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.438830    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 15:51:17.444963 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.444925    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-788d559bf-h2w55"]
Sep 10 15:51:17.535587 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.535540    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e602c1a-a893-49bc-a8b2-4fe66e345701-openshift-service-ca\") pod \"maas-api-788d559bf-h2w55\" (UID: \"0e602c1a-a893-49bc-a8b2-4fe66e345701\") " pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55"
Sep 10 15:51:17.535587 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.535591    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e602c1a-a893-49bc-a8b2-4fe66e345701-metrics-certs\") pod \"maas-api-788d559bf-h2w55\" (UID: \"0e602c1a-a893-49bc-a8b2-4fe66e345701\") " pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55"
Sep 10 15:51:17.535861 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.535637    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxjss\" (UniqueName: \"kubernetes.io/projected/0e602c1a-a893-49bc-a8b2-4fe66e345701-kube-api-access-kxjss\") pod \"maas-api-788d559bf-h2w55\" (UID: \"0e602c1a-a893-49bc-a8b2-4fe66e345701\") " pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55"
Sep 10 15:51:17.535861 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.535686    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e602c1a-a893-49bc-a8b2-4fe66e345701-maas-api-tls\") pod \"maas-api-788d559bf-h2w55\" (UID: \"0e602c1a-a893-49bc-a8b2-4fe66e345701\") " pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55"
Sep 10 15:51:17.637185 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.637137    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e602c1a-a893-49bc-a8b2-4fe66e345701-openshift-service-ca\") pod \"maas-api-788d559bf-h2w55\" (UID: \"0e602c1a-a893-49bc-a8b2-4fe66e345701\") " pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55"
Sep 10 15:51:17.637185 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.637183    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e602c1a-a893-49bc-a8b2-4fe66e345701-metrics-certs\") pod \"maas-api-788d559bf-h2w55\" (UID: \"0e602c1a-a893-49bc-a8b2-4fe66e345701\") " pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55"
Sep 10 15:51:17.637451 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.637211    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxjss\" (UniqueName: \"kubernetes.io/projected/0e602c1a-a893-49bc-a8b2-4fe66e345701-kube-api-access-kxjss\") pod \"maas-api-788d559bf-h2w55\" (UID: \"0e602c1a-a893-49bc-a8b2-4fe66e345701\") " pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55"
Sep 10 15:51:17.637451 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.637246    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e602c1a-a893-49bc-a8b2-4fe66e345701-maas-api-tls\") pod \"maas-api-788d559bf-h2w55\" (UID: \"0e602c1a-a893-49bc-a8b2-4fe66e345701\") " pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55"
Sep 10 15:51:17.637915 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.637889    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e602c1a-a893-49bc-a8b2-4fe66e345701-openshift-service-ca\") pod \"maas-api-788d559bf-h2w55\" (UID: \"0e602c1a-a893-49bc-a8b2-4fe66e345701\") " pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55"
Sep 10 15:51:17.639694 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.639671    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e602c1a-a893-49bc-a8b2-4fe66e345701-maas-api-tls\") pod \"maas-api-788d559bf-h2w55\" (UID: \"0e602c1a-a893-49bc-a8b2-4fe66e345701\") " pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55"
Sep 10 15:51:17.639806 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.639696    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e602c1a-a893-49bc-a8b2-4fe66e345701-metrics-certs\") pod \"maas-api-788d559bf-h2w55\" (UID: \"0e602c1a-a893-49bc-a8b2-4fe66e345701\") " pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55"
Sep 10 15:51:17.648842 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.648811    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxjss\" (UniqueName: \"kubernetes.io/projected/0e602c1a-a893-49bc-a8b2-4fe66e345701-kube-api-access-kxjss\") pod \"maas-api-788d559bf-h2w55\" (UID: \"0e602c1a-a893-49bc-a8b2-4fe66e345701\") " pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55"
Sep 10 15:51:17.745878 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:17.745775    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55"
Sep 10 15:51:18.035241 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:18.035115    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-788d559bf-h2w55"]
Sep 10 15:51:18.038833 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:51:18.038789    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e602c1a_a893_49bc_a8b2_4fe66e345701.slice/crio-72880740287b38e70d651ebc24570edb8dd1d49bf4e62e161d41c1ad7e2a4a9c WatchSource:0}: Error finding container 72880740287b38e70d651ebc24570edb8dd1d49bf4e62e161d41c1ad7e2a4a9c: Status 404 returned error can't find the container with id 72880740287b38e70d651ebc24570edb8dd1d49bf4e62e161d41c1ad7e2a4a9c
Sep 10 15:51:18.040763 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:18.040744    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 15:51:18.902514 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:18.902479    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55" event={"ID":"0e602c1a-a893-49bc-a8b2-4fe66e345701","Type":"ContainerStarted","Data":"72880740287b38e70d651ebc24570edb8dd1d49bf4e62e161d41c1ad7e2a4a9c"}
Sep 10 15:51:19.909545 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:19.909510    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55" event={"ID":"0e602c1a-a893-49bc-a8b2-4fe66e345701","Type":"ContainerStarted","Data":"0ea402f25075c5f80400c2588283eb86c41246ce9613f3ac5afe8f493f9ef662"}
Sep 10 15:51:19.909966 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:19.909569    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55"
Sep 10 15:51:19.928591 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:19.928535    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55" podStartSLOduration=1.987753002 podStartE2EDuration="2.928515869s" totalImagesPullingTime="940.762867ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:51:19.926347228 +0000 UTC m=+2132.976145739" watchObservedRunningTime="2026-09-10 15:51:19.928515869 +0000 UTC m=+2132.978314378"
Sep 10 15:51:25.621901 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.621863    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-788d559bf-h2w55"]
Sep 10 15:51:25.622417 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.622076    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55" podUID="0e602c1a-a893-49bc-a8b2-4fe66e345701" containerName="maas-api" containerID="cri-o://0ea402f25075c5f80400c2588283eb86c41246ce9613f3ac5afe8f493f9ef662" gracePeriod=30
Sep 10 15:51:25.628481 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.628453    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55"
Sep 10 15:51:25.656433 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.656391    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff"]
Sep 10 15:51:25.659967 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.659944    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff"
Sep 10 15:51:25.669920 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.669885    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff"]
Sep 10 15:51:25.705158 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.705117    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25abe1db-c682-4e20-8932-cacc4e2a9e14-openshift-service-ca\") pod \"maas-api-684c4cfcb5-hbtff\" (UID: \"25abe1db-c682-4e20-8932-cacc4e2a9e14\") " pod="odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff"
Sep 10 15:51:25.705158 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.705158    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25abe1db-c682-4e20-8932-cacc4e2a9e14-metrics-certs\") pod \"maas-api-684c4cfcb5-hbtff\" (UID: \"25abe1db-c682-4e20-8932-cacc4e2a9e14\") " pod="odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff"
Sep 10 15:51:25.705367 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.705223    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9npxd\" (UniqueName: \"kubernetes.io/projected/25abe1db-c682-4e20-8932-cacc4e2a9e14-kube-api-access-9npxd\") pod \"maas-api-684c4cfcb5-hbtff\" (UID: \"25abe1db-c682-4e20-8932-cacc4e2a9e14\") " pod="odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff"
Sep 10 15:51:25.705367 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.705243    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25abe1db-c682-4e20-8932-cacc4e2a9e14-maas-api-tls\") pod \"maas-api-684c4cfcb5-hbtff\" (UID: \"25abe1db-c682-4e20-8932-cacc4e2a9e14\") " pod="odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff"
Sep 10 15:51:25.805961 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.805887    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9npxd\" (UniqueName: \"kubernetes.io/projected/25abe1db-c682-4e20-8932-cacc4e2a9e14-kube-api-access-9npxd\") pod \"maas-api-684c4cfcb5-hbtff\" (UID: \"25abe1db-c682-4e20-8932-cacc4e2a9e14\") " pod="odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff"
Sep 10 15:51:25.805961 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.805961    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25abe1db-c682-4e20-8932-cacc4e2a9e14-maas-api-tls\") pod \"maas-api-684c4cfcb5-hbtff\" (UID: \"25abe1db-c682-4e20-8932-cacc4e2a9e14\") " pod="odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff"
Sep 10 15:51:25.806219 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.806045    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25abe1db-c682-4e20-8932-cacc4e2a9e14-openshift-service-ca\") pod \"maas-api-684c4cfcb5-hbtff\" (UID: \"25abe1db-c682-4e20-8932-cacc4e2a9e14\") " pod="odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff"
Sep 10 15:51:25.806219 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.806073    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25abe1db-c682-4e20-8932-cacc4e2a9e14-metrics-certs\") pod \"maas-api-684c4cfcb5-hbtff\" (UID: \"25abe1db-c682-4e20-8932-cacc4e2a9e14\") " pod="odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff"
Sep 10 15:51:25.807497 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.807078    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25abe1db-c682-4e20-8932-cacc4e2a9e14-openshift-service-ca\") pod \"maas-api-684c4cfcb5-hbtff\" (UID: \"25abe1db-c682-4e20-8932-cacc4e2a9e14\") " pod="odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff"
Sep 10 15:51:25.809230 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.809202    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25abe1db-c682-4e20-8932-cacc4e2a9e14-metrics-certs\") pod \"maas-api-684c4cfcb5-hbtff\" (UID: \"25abe1db-c682-4e20-8932-cacc4e2a9e14\") " pod="odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff"
Sep 10 15:51:25.809737 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.809716    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25abe1db-c682-4e20-8932-cacc4e2a9e14-maas-api-tls\") pod \"maas-api-684c4cfcb5-hbtff\" (UID: \"25abe1db-c682-4e20-8932-cacc4e2a9e14\") " pod="odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff"
Sep 10 15:51:25.815784 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.815755    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9npxd\" (UniqueName: \"kubernetes.io/projected/25abe1db-c682-4e20-8932-cacc4e2a9e14-kube-api-access-9npxd\") pod \"maas-api-684c4cfcb5-hbtff\" (UID: \"25abe1db-c682-4e20-8932-cacc4e2a9e14\") " pod="odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff"
Sep 10 15:51:25.879637 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.879571    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55"
Sep 10 15:51:25.906466 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.906421    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e602c1a-a893-49bc-a8b2-4fe66e345701-metrics-certs\") pod \"0e602c1a-a893-49bc-a8b2-4fe66e345701\" (UID: \"0e602c1a-a893-49bc-a8b2-4fe66e345701\") "
Sep 10 15:51:25.906659 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.906486    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e602c1a-a893-49bc-a8b2-4fe66e345701-openshift-service-ca\") pod \"0e602c1a-a893-49bc-a8b2-4fe66e345701\" (UID: \"0e602c1a-a893-49bc-a8b2-4fe66e345701\") "
Sep 10 15:51:25.906659 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.906514    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e602c1a-a893-49bc-a8b2-4fe66e345701-maas-api-tls\") pod \"0e602c1a-a893-49bc-a8b2-4fe66e345701\" (UID: \"0e602c1a-a893-49bc-a8b2-4fe66e345701\") "
Sep 10 15:51:25.906659 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.906559    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxjss\" (UniqueName: \"kubernetes.io/projected/0e602c1a-a893-49bc-a8b2-4fe66e345701-kube-api-access-kxjss\") pod \"0e602c1a-a893-49bc-a8b2-4fe66e345701\" (UID: \"0e602c1a-a893-49bc-a8b2-4fe66e345701\") "
Sep 10 15:51:25.906907 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.906876    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e602c1a-a893-49bc-a8b2-4fe66e345701-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0e602c1a-a893-49bc-a8b2-4fe66e345701" (UID: "0e602c1a-a893-49bc-a8b2-4fe66e345701"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:51:25.908800 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.908766    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e602c1a-a893-49bc-a8b2-4fe66e345701-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0e602c1a-a893-49bc-a8b2-4fe66e345701" (UID: "0e602c1a-a893-49bc-a8b2-4fe66e345701"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:51:25.908919 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.908790    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e602c1a-a893-49bc-a8b2-4fe66e345701-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0e602c1a-a893-49bc-a8b2-4fe66e345701" (UID: "0e602c1a-a893-49bc-a8b2-4fe66e345701"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:51:25.908919 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.908791    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e602c1a-a893-49bc-a8b2-4fe66e345701-kube-api-access-kxjss" (OuterVolumeSpecName: "kube-api-access-kxjss") pod "0e602c1a-a893-49bc-a8b2-4fe66e345701" (UID: "0e602c1a-a893-49bc-a8b2-4fe66e345701"). InnerVolumeSpecName "kube-api-access-kxjss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:51:25.946271 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.946229    2574 generic.go:356] "Generic (PLEG): container finished" podID="0e602c1a-a893-49bc-a8b2-4fe66e345701" containerID="0ea402f25075c5f80400c2588283eb86c41246ce9613f3ac5afe8f493f9ef662" exitCode=0
Sep 10 15:51:25.946471 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.946279    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55"
Sep 10 15:51:25.946471 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.946311    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55" event={"ID":"0e602c1a-a893-49bc-a8b2-4fe66e345701","Type":"ContainerDied","Data":"0ea402f25075c5f80400c2588283eb86c41246ce9613f3ac5afe8f493f9ef662"}
Sep 10 15:51:25.946471 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.946364    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-788d559bf-h2w55" event={"ID":"0e602c1a-a893-49bc-a8b2-4fe66e345701","Type":"ContainerDied","Data":"72880740287b38e70d651ebc24570edb8dd1d49bf4e62e161d41c1ad7e2a4a9c"}
Sep 10 15:51:25.946471 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.946386    2574 scope.go:117] "RemoveContainer" containerID="0ea402f25075c5f80400c2588283eb86c41246ce9613f3ac5afe8f493f9ef662"
Sep 10 15:51:25.956288 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.956267    2574 scope.go:117] "RemoveContainer" containerID="0ea402f25075c5f80400c2588283eb86c41246ce9613f3ac5afe8f493f9ef662"
Sep 10 15:51:25.956624 ip-10-0-142-37 kubenswrapper[2574]: E0910 15:51:25.956597    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ea402f25075c5f80400c2588283eb86c41246ce9613f3ac5afe8f493f9ef662\": container with ID starting with 0ea402f25075c5f80400c2588283eb86c41246ce9613f3ac5afe8f493f9ef662 not found: ID does not exist" containerID="0ea402f25075c5f80400c2588283eb86c41246ce9613f3ac5afe8f493f9ef662"
Sep 10 15:51:25.956723 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.956634    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ea402f25075c5f80400c2588283eb86c41246ce9613f3ac5afe8f493f9ef662"} err="failed to get container status \"0ea402f25075c5f80400c2588283eb86c41246ce9613f3ac5afe8f493f9ef662\": rpc error: code = NotFound desc = could not find container \"0ea402f25075c5f80400c2588283eb86c41246ce9613f3ac5afe8f493f9ef662\": container with ID starting with 0ea402f25075c5f80400c2588283eb86c41246ce9613f3ac5afe8f493f9ef662 not found: ID does not exist"
Sep 10 15:51:25.980819 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.980785    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-788d559bf-h2w55"]
Sep 10 15:51:25.988263 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:25.988233    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-788d559bf-h2w55"]
Sep 10 15:51:26.007191 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:26.007164    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e602c1a-a893-49bc-a8b2-4fe66e345701-metrics-certs\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:51:26.007191 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:26.007192    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e602c1a-a893-49bc-a8b2-4fe66e345701-openshift-service-ca\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:51:26.007343 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:26.007204    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e602c1a-a893-49bc-a8b2-4fe66e345701-maas-api-tls\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:51:26.007343 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:26.007214    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxjss\" (UniqueName: \"kubernetes.io/projected/0e602c1a-a893-49bc-a8b2-4fe66e345701-kube-api-access-kxjss\") on node \"ip-10-0-142-37.ec2.internal\" DevicePath \"\""
Sep 10 15:51:26.015081 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:26.015050    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff"
Sep 10 15:51:26.293473 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:26.293444    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff"]
Sep 10 15:51:26.295040 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:51:26.295009    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25abe1db_c682_4e20_8932_cacc4e2a9e14.slice/crio-f385539804d193f30e663699358defa88163bfe3b5c9fe9bb4ee4ab2716f09fb WatchSource:0}: Error finding container f385539804d193f30e663699358defa88163bfe3b5c9fe9bb4ee4ab2716f09fb: Status 404 returned error can't find the container with id f385539804d193f30e663699358defa88163bfe3b5c9fe9bb4ee4ab2716f09fb
Sep 10 15:51:26.953949 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:26.953831    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff" event={"ID":"25abe1db-c682-4e20-8932-cacc4e2a9e14","Type":"ContainerStarted","Data":"d4f44751fd3f22ef1fbd6a812c54e02bd8d3a789b62ef303b41d988d56b31a85"}
Sep 10 15:51:26.953949 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:26.953902    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff" event={"ID":"25abe1db-c682-4e20-8932-cacc4e2a9e14","Type":"ContainerStarted","Data":"f385539804d193f30e663699358defa88163bfe3b5c9fe9bb4ee4ab2716f09fb"}
Sep 10 15:51:26.954493 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:26.953961    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff"
Sep 10 15:51:26.971392 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:26.971335    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff" podStartSLOduration=1.6666339479999999 podStartE2EDuration="1.971320178s" totalImagesPullingTime="304.68623ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:51:26.970124971 +0000 UTC m=+2140.019923479" watchObservedRunningTime="2026-09-10 15:51:26.971320178 +0000 UTC m=+2140.021118685"
Sep 10 15:51:27.409115 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:27.409077    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e602c1a-a893-49bc-a8b2-4fe66e345701" path="/var/lib/kubelet/pods/0e602c1a-a893-49bc-a8b2-4fe66e345701/volumes"
Sep 10 15:51:32.968975 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:32.968944    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-684c4cfcb5-hbtff"
Sep 10 15:51:49.119439 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:49.119404    2574 scope.go:117] "RemoveContainer" containerID="75491daa004b2548b5bb652ea4dc521ce0fac219f4e7e23a6c00c2e6796ff048"
Sep 10 15:51:49.128319 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:49.128298    2574 scope.go:117] "RemoveContainer" containerID="c6189ec398991ef17182a45fcb9af6fb2a19e618e46b2177660d71691c0df357"
Sep 10 15:51:49.136241 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:49.136222    2574 scope.go:117] "RemoveContainer" containerID="2e638e81020b5744537a7f4403804a269fc96c3e1dbc4533c9de039083b5157b"
Sep 10 15:51:53.704193 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:53.704161    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jgwbd_2d5af6be-c91c-460a-803a-99244d7a809b/server/0.log"
Sep 10 15:51:53.816310 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:53.816279    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-t9f98_27d0d1c2-129d-4246-81a5-f38e3377b5a8/manager/0.log"
Sep 10 15:51:53.923983 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:53.923955    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76f847f9cd-9rd5b_f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908/copy-manifests/0.log"
Sep 10 15:51:53.932061 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:53.932033    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76f847f9cd-9rd5b_f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908/manager/0.log"
Sep 10 15:51:54.606100 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:54.606068    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-684c4cfcb5-hbtff_25abe1db-c682-4e20-8932-cacc4e2a9e14/maas-api/0.log"
Sep 10 15:51:54.713014 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:54.712985    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29817570-mbhkr_e6110a6c-cb82-4b16-a5a5-10191a0796d7/cleanup/0.log"
Sep 10 15:51:56.707491 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:56.707448    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg_676f81af-2194-425d-b987-dbcab10f6a5a/istio-proxy/0.log"
Sep 10 15:51:56.826365 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:56.826334    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9d2lk_120fee7d-369b-4394-bd2d-bd8c87117822/discovery/0.log"
Sep 10 15:51:57.165978 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:57.165877    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-4grxn_2df55bcd-b9f3-4d4e-8ea6-e3521fc06634/istio-proxy/1.log"
Sep 10 15:51:57.502084 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:57.502000    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d685f7754-28m8s_d8b23ffc-2066-4cfe-a963-7d4b004ec8b8/router/0.log"
Sep 10 15:51:57.941694 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:57.941666    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-pd52n_87a4b013-ca4c-46a0-8995-7d1cf4efc652/main/0.log"
Sep 10 15:51:58.048951 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:51:58.048906    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-ddsts_25d5d576-a241-47b7-9abf-6e463f5f354b/main/0.log"
Sep 10 15:52:06.882550 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:06.882520    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9qzxr_8bd848e3-5919-4d0a-80c9-f2bd7f7db58b/global-pull-secret-syncer/0.log"
Sep 10 15:52:07.037331 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:07.037296    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tm2gm_a965c17d-32ee-4814-8067-df4b73b8ea0a/konnectivity-agent/0.log"
Sep 10 15:52:07.155691 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:07.155613    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-37.ec2.internal_7145b012af55e41dcb0c2a41a9ae7904/haproxy/0.log"
Sep 10 15:52:13.489868 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:13.489828    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-pshjh_46fdc592-4de9-4212-8a71-e84cb6d48862/cluster-monitoring-operator/0.log"
Sep 10 15:52:13.850062 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:13.850037    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x8m5f_aeba31b7-92df-410f-b2ea-e2a2b39cb89c/node-exporter/0.log"
Sep 10 15:52:13.880309 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:13.880275    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x8m5f_aeba31b7-92df-410f-b2ea-e2a2b39cb89c/kube-rbac-proxy/0.log"
Sep 10 15:52:13.903370 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:13.903344    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x8m5f_aeba31b7-92df-410f-b2ea-e2a2b39cb89c/init-textfile/0.log"
Sep 10 15:52:14.257041 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:14.257011    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-vvj2g_6a1f2df5-5319-4911-b274-7df9b4f726a5/prometheus-operator/0.log"
Sep 10 15:52:14.287952 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:14.287902    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-vvj2g_6a1f2df5-5319-4911-b274-7df9b4f726a5/kube-rbac-proxy/0.log"
Sep 10 15:52:16.713135 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:16.713101    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/2.log"
Sep 10 15:52:16.716965 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:16.716943    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bh676_2b6778d4-2e09-485a-af8f-8e4fe72225f3/console-operator/3.log"
Sep 10 15:52:17.090772 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.090737    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"]
Sep 10 15:52:17.091220 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.091201    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e602c1a-a893-49bc-a8b2-4fe66e345701" containerName="maas-api"
Sep 10 15:52:17.091220 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.091221    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e602c1a-a893-49bc-a8b2-4fe66e345701" containerName="maas-api"
Sep 10 15:52:17.091348 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.091294    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e602c1a-a893-49bc-a8b2-4fe66e345701" containerName="maas-api"
Sep 10 15:52:17.094621 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.094600    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"
Sep 10 15:52:17.097362 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.097341    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8zzjt\"/\"openshift-service-ca.crt\""
Sep 10 15:52:17.097467 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.097392    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8zzjt\"/\"kube-root-ca.crt\""
Sep 10 15:52:17.098473 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.098455    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8zzjt\"/\"default-dockercfg-kqxjj\""
Sep 10 15:52:17.103501 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.103475    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"]
Sep 10 15:52:17.182331 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.182294    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z9fp\" (UniqueName: \"kubernetes.io/projected/803d69b7-9855-4823-943c-b994c49cf504-kube-api-access-8z9fp\") pod \"perf-node-gather-daemonset-rtwjw\" (UID: \"803d69b7-9855-4823-943c-b994c49cf504\") " pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"
Sep 10 15:52:17.182331 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.182333    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/803d69b7-9855-4823-943c-b994c49cf504-proc\") pod \"perf-node-gather-daemonset-rtwjw\" (UID: \"803d69b7-9855-4823-943c-b994c49cf504\") " pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"
Sep 10 15:52:17.182549 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.182438    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/803d69b7-9855-4823-943c-b994c49cf504-sys\") pod \"perf-node-gather-daemonset-rtwjw\" (UID: \"803d69b7-9855-4823-943c-b994c49cf504\") " pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"
Sep 10 15:52:17.182549 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.182476    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/803d69b7-9855-4823-943c-b994c49cf504-lib-modules\") pod \"perf-node-gather-daemonset-rtwjw\" (UID: \"803d69b7-9855-4823-943c-b994c49cf504\") " pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"
Sep 10 15:52:17.182549 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.182517    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/803d69b7-9855-4823-943c-b994c49cf504-podres\") pod \"perf-node-gather-daemonset-rtwjw\" (UID: \"803d69b7-9855-4823-943c-b994c49cf504\") " pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"
Sep 10 15:52:17.283872 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.283832    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/803d69b7-9855-4823-943c-b994c49cf504-sys\") pod \"perf-node-gather-daemonset-rtwjw\" (UID: \"803d69b7-9855-4823-943c-b994c49cf504\") " pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"
Sep 10 15:52:17.283872 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.283876    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/803d69b7-9855-4823-943c-b994c49cf504-lib-modules\") pod \"perf-node-gather-daemonset-rtwjw\" (UID: \"803d69b7-9855-4823-943c-b994c49cf504\") " pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"
Sep 10 15:52:17.284143 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.283900    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/803d69b7-9855-4823-943c-b994c49cf504-podres\") pod \"perf-node-gather-daemonset-rtwjw\" (UID: \"803d69b7-9855-4823-943c-b994c49cf504\") " pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"
Sep 10 15:52:17.284143 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.283981    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z9fp\" (UniqueName: \"kubernetes.io/projected/803d69b7-9855-4823-943c-b994c49cf504-kube-api-access-8z9fp\") pod \"perf-node-gather-daemonset-rtwjw\" (UID: \"803d69b7-9855-4823-943c-b994c49cf504\") " pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"
Sep 10 15:52:17.284143 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.283999    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/803d69b7-9855-4823-943c-b994c49cf504-sys\") pod \"perf-node-gather-daemonset-rtwjw\" (UID: \"803d69b7-9855-4823-943c-b994c49cf504\") " pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"
Sep 10 15:52:17.284143 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.284005    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/803d69b7-9855-4823-943c-b994c49cf504-proc\") pod \"perf-node-gather-daemonset-rtwjw\" (UID: \"803d69b7-9855-4823-943c-b994c49cf504\") " pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"
Sep 10 15:52:17.284143 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.284036    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/803d69b7-9855-4823-943c-b994c49cf504-lib-modules\") pod \"perf-node-gather-daemonset-rtwjw\" (UID: \"803d69b7-9855-4823-943c-b994c49cf504\") " pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"
Sep 10 15:52:17.284143 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.284042    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/803d69b7-9855-4823-943c-b994c49cf504-podres\") pod \"perf-node-gather-daemonset-rtwjw\" (UID: \"803d69b7-9855-4823-943c-b994c49cf504\") " pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"
Sep 10 15:52:17.284143 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.284047    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/803d69b7-9855-4823-943c-b994c49cf504-proc\") pod \"perf-node-gather-daemonset-rtwjw\" (UID: \"803d69b7-9855-4823-943c-b994c49cf504\") " pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"
Sep 10 15:52:17.293694 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.293661    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z9fp\" (UniqueName: \"kubernetes.io/projected/803d69b7-9855-4823-943c-b994c49cf504-kube-api-access-8z9fp\") pod \"perf-node-gather-daemonset-rtwjw\" (UID: \"803d69b7-9855-4823-943c-b994c49cf504\") " pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"
Sep 10 15:52:17.323593 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.323570    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6fd56c4b48-tw2fg_2b54966a-e32a-4d80-878e-9b0bdd403256/console/0.log"
Sep 10 15:52:17.355647 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.355543    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-jwxcq_ddb1ead0-f944-4234-95d3-a7d19ff1578a/download-server/0.log"
Sep 10 15:52:17.405329 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.405299    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"
Sep 10 15:52:17.686585 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:17.686558    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"]
Sep 10 15:52:17.687850 ip-10-0-142-37 kubenswrapper[2574]: W0910 15:52:17.687825    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod803d69b7_9855_4823_943c_b994c49cf504.slice/crio-8421256d01fc6c3e3f39e6fb90cf9ee07ad20dd9f41bdd9c2a62d1010d1a4dcf WatchSource:0}: Error finding container 8421256d01fc6c3e3f39e6fb90cf9ee07ad20dd9f41bdd9c2a62d1010d1a4dcf: Status 404 returned error can't find the container with id 8421256d01fc6c3e3f39e6fb90cf9ee07ad20dd9f41bdd9c2a62d1010d1a4dcf
Sep 10 15:52:18.070315 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:18.070263    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-pvdcp_75b30207-2908-4328-bc6c-0b2b0bf59df0/volume-data-source-validator/0.log"
Sep 10 15:52:18.237476 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:18.237441    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw" event={"ID":"803d69b7-9855-4823-943c-b994c49cf504","Type":"ContainerStarted","Data":"c989d23690d308136861db43d683dfd9a30bca240571a6752d34e835559bca94"}
Sep 10 15:52:18.237655 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:18.237497    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw" event={"ID":"803d69b7-9855-4823-943c-b994c49cf504","Type":"ContainerStarted","Data":"8421256d01fc6c3e3f39e6fb90cf9ee07ad20dd9f41bdd9c2a62d1010d1a4dcf"}
Sep 10 15:52:18.237655 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:18.237540    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"
Sep 10 15:52:18.255852 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:18.255805    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw" podStartSLOduration=1.255791155 podStartE2EDuration="1.255791155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:52:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:52:18.254155668 +0000 UTC m=+2191.303954178" watchObservedRunningTime="2026-09-10 15:52:18.255791155 +0000 UTC m=+2191.305589662"
Sep 10 15:52:19.318427 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:19.318390    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ppwfd_f467c0b7-a81b-441e-b76f-288d7ade6d46/dns/0.log"
Sep 10 15:52:19.338902 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:19.338870    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ppwfd_f467c0b7-a81b-441e-b76f-288d7ade6d46/kube-rbac-proxy/0.log"
Sep 10 15:52:19.456150 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:19.456118    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bj7vg_4ba47f2c-aa01-49e8-8b3a-2534c01624a4/dns-node-resolver/0.log"
Sep 10 15:52:20.119349 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:20.119321    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9ctw2_a7ffe6a3-b6d6-4481-b023-95ad5eae05fc/node-ca/0.log"
Sep 10 15:52:21.191510 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:21.191481    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg_676f81af-2194-425d-b987-dbcab10f6a5a/istio-proxy/0.log"
Sep 10 15:52:21.418329 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:21.418301    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9d2lk_120fee7d-369b-4394-bd2d-bd8c87117822/discovery/0.log"
Sep 10 15:52:21.497625 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:21.497516    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-4grxn_2df55bcd-b9f3-4d4e-8ea6-e3521fc06634/istio-proxy/0.log"
Sep 10 15:52:21.505297 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:21.505273    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-4grxn_2df55bcd-b9f3-4d4e-8ea6-e3521fc06634/istio-proxy/1.log"
Sep 10 15:52:21.614059 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:21.614031    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d685f7754-28m8s_d8b23ffc-2066-4cfe-a963-7d4b004ec8b8/router/0.log"
Sep 10 15:52:22.545664 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:22.545611    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xlrmn_88a69307-bfe3-4f8a-b5c3-f9387e0d66f0/serve-healthcheck-canary/0.log"
Sep 10 15:52:23.112812 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:23.112771    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-c2d27_c2daa35c-0530-448c-82d6-51be02389e4b/insights-operator/0.log"
Sep 10 15:52:23.113183 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:23.113162    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-c2d27_c2daa35c-0530-448c-82d6-51be02389e4b/insights-operator/1.log"
Sep 10 15:52:23.149508 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:23.149478    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c2sj5_d79323d6-7b38-4e55-b8c8-12cdd2a27298/kube-rbac-proxy/0.log"
Sep 10 15:52:23.172947 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:23.172911    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c2sj5_d79323d6-7b38-4e55-b8c8-12cdd2a27298/exporter/0.log"
Sep 10 15:52:23.216677 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:23.216642    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c2sj5_d79323d6-7b38-4e55-b8c8-12cdd2a27298/extractor/0.log"
Sep 10 15:52:24.252850 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:24.252818    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8zzjt/perf-node-gather-daemonset-rtwjw"
Sep 10 15:52:26.065103 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:26.065082    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jgwbd_2d5af6be-c91c-460a-803a-99244d7a809b/server/0.log"
Sep 10 15:52:26.149016 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:26.148977    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-t9f98_27d0d1c2-129d-4246-81a5-f38e3377b5a8/manager/0.log"
Sep 10 15:52:26.176892 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:26.176853    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76f847f9cd-9rd5b_f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908/manager/0.log"
Sep 10 15:52:26.200260 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:26.200231    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76f847f9cd-9rd5b_f4cc8a41-2f9b-4209-8a3b-dfb5ab4ed908/copy-manifests/0.log"
Sep 10 15:52:27.771809 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:27.771781    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-578d56c89f-crgmt_e07508ed-67e5-4ab4-9d09-6763cb5e77d0/manager/0.log"
Sep 10 15:52:27.848356 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:27.848329    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg_676f81af-2194-425d-b987-dbcab10f6a5a/istio-proxy/0.log"
Sep 10 15:52:28.078495 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:28.078463    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9d2lk_120fee7d-369b-4394-bd2d-bd8c87117822/discovery/0.log"
Sep 10 15:52:28.137981 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:28.137945    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-4grxn_2df55bcd-b9f3-4d4e-8ea6-e3521fc06634/istio-proxy/0.log"
Sep 10 15:52:28.145863 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:28.145842    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-4grxn_2df55bcd-b9f3-4d4e-8ea6-e3521fc06634/istio-proxy/1.log"
Sep 10 15:52:28.224301 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:28.224271    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d685f7754-28m8s_d8b23ffc-2066-4cfe-a963-7d4b004ec8b8/router/0.log"
Sep 10 15:52:29.761940 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:29.761894    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c9tcgg_676f81af-2194-425d-b987-dbcab10f6a5a/istio-proxy/0.log"
Sep 10 15:52:29.979821 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:29.979792    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9d2lk_120fee7d-369b-4394-bd2d-bd8c87117822/discovery/0.log"
Sep 10 15:52:30.039312 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:30.039229    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-4grxn_2df55bcd-b9f3-4d4e-8ea6-e3521fc06634/istio-proxy/0.log"
Sep 10 15:52:30.047150 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:30.047127    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-4grxn_2df55bcd-b9f3-4d4e-8ea6-e3521fc06634/istio-proxy/1.log"
Sep 10 15:52:30.121246 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:30.121219    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d685f7754-28m8s_d8b23ffc-2066-4cfe-a963-7d4b004ec8b8/router/0.log"
Sep 10 15:52:33.695547 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:33.695510    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-hl6dl_24c1b5a4-af41-477d-b635-5a9f877aa79e/kube-storage-version-migrator-operator/1.log"
Sep 10 15:52:33.696012 ip-10-0-142-37 kubenswrapper[2574]: I0910 15:52:33.695627    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-hl6dl_24c1b5a4-af41-477d-b635-5a9f877aa79e/kube-storage-version-migrator-operator/0.log"